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presentation  at  the  AECT  Convention  and  included  in  this  Proceedings  were 
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to  Dr.  Rhonda  Robinson  of  Northern  Illinois  University,  who  coordinated  the 
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the  manuscripts  submitted  for  consideration  were  selected  for  presentation 
at  the  Convention  and  for  publication  in  these  Proceedings.     The  papers 
contained  in  this  document  represent  some  of  the  most  current  thinking  in 
educational  communications  and  technology. 

This  volume  contains  two  cumulative  indexes  covering  the  first  seven 
volumes,  1979-85.    The  first  is  an  author  index.    The  second  is  a  descriptor 
Index.     The  two  indexes  will  be  updated  in  future  editions  of  this  Proceedings. 
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Abstraqf 


"Lack  of  effort"  is  a  major  reason  for  non-success  among  students  in 

remedial  mathematics.    It  has  been  theorized  that  the  presence  of  a  reward,  or 

1  • 

incentive,  may  Increase  motivation  in  this  learner  group.    The  present  study 
was  designed  to  survey  student  attitudes  toward  incentive  options  in  a 
competency-based  remedial  algebra  course.    Pour  hundred  twenty-one  students 
completed  a  two-part  survey  form;    "Course  credit  to  count  toward  graduation" 
received  an  overwhelm!  igly  favorable'  reaction.    Of  the  ten  incentives 

surveyed,  only  two  others  - received  favorable  responses:    "preference  during 

♦ 

course  registration*  and  "release  from  required  class  attendance."    *be  others 

^ 

were  not  considered  viable  Incentive  options. 


9 
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Student  Incentive  Preferences  in  a 
Competency-Based  Remedial  Algebra  Course 


Sparking  student  interest  in  learning  is  a  prime  concern  of  Instructors 
and  administrators  of  remedial  mathematics  programs  in  post-secondary 
education.    According  to  a  survey  of  remedial  service  administrators  at 

two-year  colleges,  "lack  of  effort"  was  considered  the  major  obstacle  to 

\ 

learning  among  low-achieving  students,  while  "low  intelligence"  was  rated  the 
lea£t  likely  reason  for  non-success  among  seven  possible  causes  (Cross,  41971). 
Motivation  is  a  particularly  important  factor  among  "high  risk"  students  whose 
backgrounds  tf*  *n  require  careful  reconstruction  of  learning  patterns 
(Greising,  1969). 

The  recent  proliferation  of  remedial  programs  has  brought  vast  numbers  of 
disinterested,  unmotivated  students  to  college  mathematics  departments.  Over 
75  percent  of  all  four-year  institutions  and  95  percent  of  all  community 
colleges  now  have  some  kind  of  preparatory  math  program  (Lindberg,  1977).  In 
fact,  Steen  (1978)  notes  that  "the  fastest  growing  subject  in  freshman  college 
mathematics  is  grade  school  arithmetic." 

Kerr  and  Lang  (1981)  classify  remedial  algebra  students  into  four  general 
categories: 

1.  A-level  students  who  are  actiye,  self -motive ted,  and  successful; 

2.  students  who  are  passive,  unmotivated,  disaffected  in  class,  and 
unwilling  to  do  any  more  work  than  necessary,  but  are  able  to  pass  at  a 
minimal  level ; 

3.  active,  motivated  students  who  attempt  to  learn  but  do  not  achieve 
success  because  of  math  anxiety  or  other  factors;  and 

ERIC  413 
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Page  2  4  . 

4.    passive,  unmotivated,  indifferent  students  who  make  little  effort  and 
do  not  succeed* 

%  ■ 

According  to  Kerr  and  Lang,  groups  1  and  3  put  forth  a  sincere  attempt  to 
learn  the  material,  while  groups  2  and  4  have  the  capability  to  learn  but  are 
not  compelled  to  try.    These  are  the  students  for  idiom  incentives  may  be 
necessary  to  motivate  them  to  reach  their  learning  potential. 

Although  the  concept  that  performance  can  be  improved  by  increasing 
motivation  is  not  universally  accepted  (Klingelhofer  &  Hollander,  1973),  a 
tenet  of  expectancy  theory  states  that  students  can  be  inspired  to  increase 
their  effort  if  a  reward  is  likely  to  follow  successful  task  performance 
(Slavin,  1977).    Moreover,  studies  by  Atkinson  (1958)  suggest  that  the  more 
attractive  the  reward,  the  more  vigorous  an  effort  is  likely  to  be  expended  by 
the  learner.    Greising  (1969)  points  out  that  the  need  for  immediate  rewards, 
as  opposed  to  the  long-range  incentive  of  degree  achievement,  is  much  more 
acute  for  high  risk  learners. 

The  purpose  of  a  reward  is  to  restructure  the  student's  environment  so 
that  achievement  of  educational  goals  is  more  compelling.    The  literature  on 
incentives  seems  to  confirm  that  the  use  of  appropriate  rewards  may  indeed 
have  a  significant  effect  on  learning  (Lipe  &  Jung,  1971). 

The  incentive  options  available  for  use  by  college  faculty  members  appear 
to  have  received  little  attention  from  researchers.    Bebeau,  Eubanks,  and 
Sullivan  (1977)  tested  preferences  for  10  incentives  commonly  offered  in 
college  courses,  using  the  paired  comparison  method  with  psychology  students. 
"Release  from  final  exam"  was  the  overwhelming  favorite,  followed  by  "points 
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toward  class  grade."    -No  reward"  and  "assisting  the  instructor  as  proctor" 
were  the  least  preferred.    Bebeau  and  Sullivan  (1982)  then  replicated  the 
study  with  upper-division  education  majors  and  obtained  nearly  identical 
results.    "Release  from  final  exam"  was  again  the  most  preferred  option,  with 
"positive  comments  from  instructor"  ranked  second. 

Several  of  the  incentives  tested  by  Bebeau  and  her  colleagues,  including 
the  two  most  highly  preferred  in  the  1977  study,  are  not  appropriate  in  a 
competency-based  program,  where  advancement  depends  upon  achievement  of 
specific  criteria.    The  present  study  was  designed  to  examine  student 
preferences  for  rewards  that  are  consistent  with  the  competency-based 
approach. 

Method 

Subjects 

Subjects  were  421  students  enrolled  in  a  remedial  algebra  course  at  Iowa 
State  University.    In  an  attempt  to  facilitate  student  progress  and  improve 
quality  control,  the  course  was  converted  in  1982  to  a  modular, 
competency-ba3ed  format  with  individual  module  prescriptions  for  each  student 
determined  by  performance  on  a  diagnostic  test,. 

Instruments 

Incentives  included  in  the  survey  were  carefully  screened  to  meet  two 
criteria.    First,  each  incentive  must  be  under  the  direct  control  of  the 

c 
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instructor,  department,  or  university,  rather  than  under  the  control  of  the 
student.    For  example 9  "personal  expectations, "  which  is  a  powerful  motivator 
for  students  with  high  levels  of  achievement  motivation,  cannot  easily  be 
manipulated  by  the  instructor  and  therefore  is  impractical  as  au  extrinsic 
reward.    Second,  the  incentive  mist  be  performance-contingent.    In  the  case  of 
a  competency-based  course,  it  must  be  available  to  all  students  who  meet  the 
required  criterion  levels  and  not  available  to  those  who  do  not. 

Three  of  the  ten  incentives  examined  by  Bebeau  and  Sullivan  (1982)  were 
considered  appropriate  for  this  study:    "release  frora  required  class 
attendance,"  " verbal  praise  from  the  instructor,"  and  "no  reward  at  all." 
Those  deleted  Included  "course-related  field  trips,"  "discussion  with 
authority,"  and  "recognition  in  publications,"  which  did  not  seem  suitable  for 
a  remedial  mathematics  course. 

Course  credit  is  an  important  issue  that  the  investigator^  felt  should  be 
on  the  list.  Many  institutions,  including  Iowa  State  University ,  do  not  award 
academic  credit  for  remedial  mathematics  courses. 

The  list  of  incentives  selected  were  reviewed  and  validated  by  colleagues 
of  the  investigator.    Included  were: 

1.  Awarding  of  course  credit  to  count  toward  graduation. 

.   -<  o 

2.  Awarding  of  course  credit  not  to  count  toward  graduation. 

i 

3.  Preference  during  course  registration. 

4.  Release  from  required  olass  attendance. 

5.  Opportunity  to  serve  as  tutor. 

6.  Posting  of  names  of  those  who  achieve  high  module  scores. 
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7.  Verbal  praise  from  the  instructor. 

8.  Reporting  of  module  success  to  advisor. 

9.  Reporting  of  module  success  to  parents. 

10.  No  reward  at  all. 

The  survey  instrument  took  the  form  of  a  two-part  incentive  preference 
scale.    Part  I  was  based  on  Atkinson's  (1958)  theory  that  the  rewards 
perceived  to  be  the  most  attractive  to  students  are  likely  to  be  the  most 
effective  as  incentives.    Therefore,  subjects  were  asked  to  rate  each 
Incentive  independently  on  a  seven-point,  Likert-type  scale  with  "very 
desirable"  at  one  extreme  and  "very  undesirable"  at  the  other. 

Part  II  employed  the  paired  comparison  method  described  by  Edwards 
(1957).    Each  option  was  paired  with  every  other  incentive  to  form  a  list  of 
45  pairs.    The  presentation  sequence  was  selected  at  random.    Students  were 
asked  to  consider  each  incentive, in  eaoh  pair  and  mark  the  one  they  perceived 
to  be  the  more  desirable. 


Procedure 

The  survey  was  administered  during  the  first  fifteen  minutes  of  a 
regularly  scheduled  class  period  in  the  fifth  week  of  fall  semester  classes. 
All  sixteen  sections  of  the  course  participated. 

Subjects  were  given  the  questionnaire  in  printed  format.  Instructions 
were  typed  at  the  beginning  of  each  part  and  also  were  provided  orally. 
Complete  anonymity  was  guaranteed. 
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Results 

Paired  Comparisons 

The  paired  comparison  data  were  analyzed  by  tabulating  the  ten  incentives 
in  rows  and  columns.    Percentages  were  entered  by  column  to  indicate  the 
proportion  of  student  preference  for  that  incentive  over  the  incentive  listed 
in  each  row  (Edwards,  1957).    The  results  appear  in  Table  1. 


Insert  Table  1  about  here 


"Course  credit  to  count  toward  graduation"  was  the  overwhelming  choice  as 
most  desirable  incentive.    Ninety-one  percent  of  the  students  preferred 
graduation  credS  over  all  other  options.    "Preference  during  course 
registration1*  ami  "release  from  required  class  attendance"  were  also  preferred 
by  large  majorities  over  other  incentive  options.    In  the  rank  ordering,  "no 
reward  at  all"  finished  last,  barely  behind  a  reward  receiving  surprisingly 
little  support,  "course  credit  not  to  count  toward  graduation." 

The  percentages  for  each  column  were  summed  and  converted  to  scale  values 
reflecting  deviation  units  above  the  least  preferred  option,  according  to  the 
Case  V  Model  of  Edwards  (1957).    This  procedure  presents  an  accurate 
perspective  of  student  preference  for  each  incentive  in  comparison  with  the 
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other  alternatives.    The  degree  of  preference  for  "course  credit  to  count 
toward  graduation"  was  illustrated  by  its  scale  value,  2.178,  more  than  two 
deviation  units  above  the  least  preferred  ohoioe.    Scale  values  of  1.567  and 
1.162  were  calculated  for  "preference  during  course  registration"  and  "release 
from  required  class  attendance,11  respectively.    None  of  the  other  seven  \ 
rewards  had  scale  values  more  than  one  deviation  unit  above  the  lowest  ranked 
option. 

The  validity  of  the  results  is  dependent  upon  the  consistency  of  subject 
responses.    According  to  logic,  if  Option  1  is  preferred  over  Option  2  and 
Option  2  over  Option  3,  then  Option  1  should  also  be  favored  over  Option  3. 
If  Option  3  is  preferred  over  Option  1,  the  result  is  what  Kendall  (1918) 
describes  as  a  circular  triad,  an  inconsistency.    Ideally,  the  number  of 
circular  triads  in  any  set  of  paired  comparison  responses  should  be  minimized. 

Kendall  developed  a  formula  for  the  coefficient  of  consistency  (zeta) 
that  incorporates  the  number  of  circular  triads  and  provides  a  measure  of 
within-subject  consistency  of  ratings  (Edwards,  1957).    The  zeta  value  is 
determined  individually  for  each  subject  and  evaluated  according  to  the  V" 
distribution.    It  can  be  calculated  from  Kendall *s  formula  that  with  ten 
stimuli  being  compared  (df  =20);  a  zeta  score  of  approximately  .15  is 
required  for  statistical  significance  at  the  .05  level  and  .57  for 
significance  at  the  .01  level.    Zeta  scores  of  .45  or  higher  were  obtained  for 
98  percent  of  the  subjects,  and  96  percent  achieved  zeta  scores  of  .57  or 
higher.    In  fact,  72  percent  had  zeta  scores  of  .90  or  higher,  indicating  an 
extremely  high  rate  of  consistency. 

Since  subjects  may  be  perfectly  consistent  in  their  responses  yet  not 
agree  with  each  other,  Kendall  also  developed  a  statistic  desicnated  u,  the 
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coefficient  of  agreement  (Edwards,  1957).    A  value  of  1  is  obtained  when  there 
is  perfect  agreement  among  the  judges.    The  minimum  possible  value  of  u  is  a 
function  of  the  number  of  judges  but  can  never  be  less  than  -1.    Any  positive 
value  of  u  indicates  some  degree  of  agreement.    The  coefficient  of  agreement 
obtained  was  Using  Kendall's  test  of  significance  for  u,  which  is  also 

tested  against  the  ^distribution,  a  lvalue  of  6574.01  was  obtained,  df  e 
45,  p  <.001,  confirming  a  highly  significant  degree  of  agreement  among 
raters. 

Attitude  Scale 

While  the  calculation  of  scale  values  according  to  Edwards'  Case  V  Model 
is  one  means  of  determining  the  strength  of  subject  feelings  toward  any  one 
option,  another  technique  is  the  evaluation  of  each  stimulus  independently 
using  a  Likert-type  rating  scale.    The  results  of  part  I  of  the  questionnaire 
may  be  found  in  Table  2.    The  rank  order  obtained  using  this  method  was  nearly 
identical  to  that  indicated  in  Table  1,  with  only  the  seventh  and  eighth 
choices  reversed. 


Insert  Table  2  about  here 


Table  2  also  provides  the  percentage  of  subjects  responding  favorably 
(1-3),  indifferently  (4),  and  unfavorably  (5-7)  to  each  item.    The  enthusiasm 
for  "course  credit  to  count  toward  graduation"  is  confirmed  by  Table  2. 
Ninety-three  percent  of  the  subjects  responded  positively  to  this  incentive, 
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and  the  mean  score  of  1.71  Indicated  that  the  majority  of  responses  were' 


"Preference  during  course  registration"  was  again  a  clear-cut  second 
choice,  with  67  percent  in  favor  and  just  13  percent  considering  it 
undesirable.    Only  one  other  incentive  listed  was  deemed  desirable  by  as  many 
as  40  percent  of  the  subjects.    Nearly  twice  as  many  favored  "release  from 
required  class  attendance"  as  opposed  it,  53  percent  to  27  percent,  but  the 
mean  score  of  3.57  indicated  few  extremely  positive  ratings  and  only  moderate 
interest  overall. 

A  Pearson  product -moment  correlation  was  calculated  to  determine  the 
degree  of  consistency  between  the  scale  values  from  the  paired  comparisons  and 
the  mean  rating  scores  from  the  seven-point  attitude  scale.    The  resulting  r 
of  .98  (p  <.O01)  confirmed  that  subjects  marked  both  parts  of  the 
questionnaire  consistently. 


If  it  is  true  that  high  risk  students  need  a  reward  structure  to  increase 


reward,  the  stronger  its  incentive  value  (Atkinson,  1958),  it  appears  that  few 
3pf  the  rewards  consistent  with  a  competency-based  system  may  be  effective  with 
students  in  remedial  mathematics.    Only  three  of  the  potential  rewards 
evaluated  in  this  study  aroused  much  student  interest. 

It  should  not  be  surprising  that  course  credit  counting  toward  graduation 
was  held  in  such  high  regard.    The  course  at  Iowa  State  University  requires 


highly  positive. 


Discussion 


their  incentive  to  learn  (Greising,  1969)  and  that  the  more  desirable  the 
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Just  as  much  time  and  effort  as  freshman-level  courses.  Mathematlos 
departments  typically  resist  offering  academic  credit  for  remedial  algebra 
because  incoming  students  are  expected  to  have  learned  this  material  in  high 
school.    However,  Cross  (1976)  feels  that  degree  credit  should  be  granted  for 
remedial  courses.    She  points  out  that  the  students  most  in  need  of 
remediation  are  those  who  have  found  little  meaning  and  satisfaction  in 
learning.    For  them  to  complete  successfully  what  may  be  (for  them)  a 
demanding  course  only  to  be  denied  academic  credit  may  reinforce  the  hollow 
feeling  they  luve  about  education.    Cross  notes  that  credit  is  the  most 
significant  immediate  and  tangible  reward  that  colleges  and  universities  have 
to  offer. 

Response  to  "course  credit  jnot  to  count  toward  graduation"  was 
unexpected.    It  had  been  hypothesized  that  graduation  credit  would  be  highly 
regarded  but  that  academic  credit  of  any  kind  would  be  a  viable  incentive. 
Two  participating  classes  were  given  informal  post-hoc  interviews  to  solicit 
their  rationale  for  responding  as  they  did.    Students  resented  having  to  take 
courses  that  did  not  count  toward  their  graduation  requirements,  regardless  of 
whether  academic  credit  was  offered.    Moreover,  they  did  hot  want  non-degree 
credit  courses  to  influence  their  grade-point  averages. 

"Preference  during  course  registration"  appears  to  be  an  incentive  that 
rates  serious  consideration.    Competition  for  seats  in  high-demand  courses  is 
keen  at  many  institutions,  and  large  numbers  of  students,  particularly 
underclassmen,  are  often  "closed  out."    The  possibility  of  obtaining  "head  of 
the  line"  privileges  at  preregi strati on  if  a  remedial  course  is  completed 
successfully  may  be  a  powerful  incentive.    Since  a  competency-baaed  system 
often  increases  the  number  of  incomplete  grades  awarded,  registrars  may  be 
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willing  to  grant , registration  privileges  in  a  trade  for  sore  passing  grades 
and  fewer  incompletes  to  be  processed. 

Moderate  support  was  given  to  "reporting  of  module  success  to  advisors." 
Most  students  enrolled  in  the  program  are  freshmen,  many  of  them  admitted 
conditionally  because  of  low  high  school  grades,  and  the  idea  of  confirming 
their  progress  by  sending  notes  to  their  advisors  may  have  been  appealing  to 
this  group.    However,  this  incentive  had  the  highest  percentage  of  "no 
opinion"  responses.    (See  Table  2. )  *  * 

S 

Vnile  "verbal  praise  from  the  instructor"  received  the  fourth  highest 
percentage  of  positive  responses  on  the  seven-point  scale  (see  Table  2),  the 
mean  score  of  4.03  was  considerably  lower  than  that  obtained  for  the  same 
Incentive  by  Be beau,  fidwards,  and  Sullivan  (1977),  2.78,  and  Be beau  and 
Sullivan  (1982),  2.69.    The  differences  (may  well  have  been  a  function  of  the  / 
courses  in  which  the  data  were  collected  and  the  attitudes  of  the  students 
surveyed.    It»  supported  Cross's  (1976)  belief  that  tangible  rewards  seem  to  be 
more  effective  for  students  in  remedial  courses. 

The  results  of  this  study  provide  additional  insight  into  the  inoentive 
preferences  of  students  enrolled  in  a  remedial  mathematics  program.    The  key 
issue  yet  to  be  resolved  is  whether  implementation  of  a  system  using  an 
incentive  program  would  actually  have  a  positive  effect  in  improving  student 
performance. 
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Table  1 

Student  Preferences  for  Incentives 
When  Presented  In  Pairs,  by  Percent 

» 

Scale 


* 

Value 

1 

2 

i 

4 

1 

6 

1 

8 

£ 

Course  credit  —  counts  toward 
graduation 

2.178 

08 

14 

m  09 

17 

f\09 

07 

Oo 

nil 
0*1 

1 A 
1U 

UO 

n(t 
uo 

2. 

c. 

Course  eredit  —  not  to  count 
toward  graduation  " 

0.137 

92 

86 

75 

DO 

CO. 

oo 

do 

AO 

5«> 
jj 

3. 

Preference  during  p re- 
registration 

1.567, 

86 

14 

— 

43 

17 

10 

15 

17" 

.11 

07 

4. 

Release  froo  required  class 
attendance 

1.162 

83 

25 

57 

— 

27 

25 

27 

33 

28 

"  15 

5. 

Opportunity  to  serve  cs 
tutor 

0.420 

93 

• 

32 

83 

73 

— 

56 

65 

60 

55 

37 

6. 

Posting  of  name  of  high 
scorers 

0.460 

94 

• 

32 

* 

90 

iff 

hli 

44 

0/ 

D 1 

7. 

Verbal  praise  from  Instructor 

0.513 

96 

38 

85 

73 

35 

49 

64 

51 

24 

8. 

Reporting  of  scores  tc 
advisors 

0.787  . 

90 

25 

83 

67 

40 

•  33 

36 

42 

19 

9. 

Reporting  of  scores  to 
parents 

0.516 

94 

31 

89 

72 

45 

49 

49 

58 

9 

29 

10. 

llo  reward  at  all 

0.000 

24 

H5 

22 

& 

§1 

11 

2i 

81 

11 

Mean  percentage 

91 

28 

76 

64 

38 

41 

43 

52 

42 

25 

Rank  order 

1 

9 

2 

3 

•  8 

7 

5 

4 

6 

10 
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Rank 


Table  2 

Student  Preferences  for  Incentives 
Considered  Independently,  by  Percent 


4 


Order       Incentive  For      Indif      Against  X 

t         Course  credit  to  count  93         04  03  1.71 

toward  graduation 

2  "Preference  during  course  67         20  13  2.87 
registration 

3  Release  from  required  53         20  27  3.57 
class  attendance 

4  Reporting  of  modules  36         35  29  3,90 

success  to  advisor  * 

5  Verbal  praise  from  39         28  33  4.03 
instructor 

6  Reporting  of  module  30         27  43  4.40 
success  to  parents 

b 

7  Posting  of  names  of  26  24  50  4.57 
those  with  high  scores 

8  Opportunity  to  serve  as  24         23  53  4.66 
tutor 

9  Course  credit  not  to  26         09  65  5.04 
count  toward  graduation 

10  No  reward  at  all  10  13  77  5.74 
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The  Instructional  Graphics  Checklist: 

1 

A  Look  at  the  Design  of  Graphics  in  Courseware 
Kathryn  Alesandrini 
California  State  University f  Los  Angeles 

An  overemphasis  on  verbal  instruction  has  teen  blamed  in  part  for  the 
current  crisis  in  education  as  the  preponderence  of  new  terminology  in 
textbooks  exceeds  the  learner's  ability  to  absorb  new  vocabulary*  For 
example ,  secondary  textbooks  in  science  rare  found  to  present  10-20  new 
terms  per  page  and  well  over  10,000  new  terms  per  book  (Yager,  1983)*'  In 
contrast »  science  textbooks  were  found  to  have  only  1-2  instructional 
pictures  per  page  (Brody,  1982-83).    Yet  there  is  convincing  evidence  that 
relevant  pictures  can  significantly  facilitate  learning  tor  both  adults 
(Alesandrini,  1984a)  and  children  (Pressley,  1977).  Microcomputer-based 
instruction  offers  the  potential  of  presenting  information  in  a  pictorial 
or  graphic  form  rather  than  in  an  all-verbal  format,  yet  this  potential  has 
not  been  fully  explored  or  developed.    A  recent  survey  of  60  commercial  CAI 
lessons  found  that  most  of  the  lessons  used  few  or  no  graphics  to  communi- 
cate the  main  points  (Alesandrini,  1984b).    The  Instructional  Graphics 
Checklist  was  developed  to  reflect  the  research  findings  about  pictures  in 
instruction  and  to  serve  as  an  informal  evaluation  instrument  for  educators 
to  use  in  determining  whether  a  CAI  lesson  is  making  appropriate  use  of  _ 
graphics  in  instruction. 
Part  One:    Use  of  Graphics 

The  incidence  of  graphics  in  CAI  lessons  is  difficult  to 

quantify  because  the  number  of  graphics  shown  depends  on  the  length  of  the 

V 

Presented  at  the  annual  meeting  of  the  Association  for  Educational 
Communications  and  Technology,  January  1985,  Anaheim,  CA. 

i  28  ,9 


lesson.    For  purposes  of  the  checklist,  the  use  of  graphics  in  the  lesson 
was  quantified  by  the  percentage  of  total  lesson  time  that  involved  display 
of  graphics  on  the  display  screen.    Hie  four  categories  include:  no 
graphics  displayed,  graphics  displayed  at  least  1/4  of  the  time,  1/2  of  the 
time,  and  more  than  1/2  of  the  time.    Research  on  pictures  generally 
supports  the  use  of  graphics  (Alesandrini ,  1984a;1982;in  press).  However, 
the  studies  on  picture  effects  vary  widely  on  the  basis  of  frequency  of 
picture  incidence.    For  example,  researchers  report  using  one  picture  to 
illustrate  each  concept  or  sentence  (Guttmann,  Levin,  &  Pressley,  1977), 
one  picture  to  illustrate  each  paragraph  (DeRose,  1976),  several  pictures 
per  lesson  (Vernon,  1954),  or  one  picture  per  lesson  (Wardie,  1977).  But 
since  studies  generally  show  that  pictures  facilitate  recall  of  information 
portrayed  in  the  picture,  the  checklist  reflects  the  notion  that  a  higher 
incidence  of  pictures  is  desirable.    It  should  also  be  noted  that  most  of 
the  picture  research  is  based  on  studies  that  did  NOT  involve  computer- 
based  instruction.    However,  several  studies  confirm  the  picture  effect  for 
CAI  (Alesandrini  &  Rigney,  1981;  Rigney  &  Lutz,  1976). 
Part  Two:    Relevance  of  Graphics 

It  may  seem  intuitively  obvious  that  graphics  should  be  related  to  the 
topic  of  the  CAI  lesson  yet  any  casual  explanation  of  current  coursevar^ 
usually  reveals  an  abundance  of  irrelevant  graphics.    It  is  not  surprising 
that  research  studies  have  shown  that  irrelevant  or  inaccurate  pictures  as 
well  as  those  used  only  for  embellishment  can  fail  to  facilitate  memory  and 
may  even  have  adverse  effects  (Baker  &  Popham,  1969;  Peeck,  1974).  Of 
course,  graphics  do  attract  attention  and  can  spark  the  learner's 
motivation.    But  in  order  to  be  truly  effective,  graphics  in  CAI  should  be 
relevant  to  the  topic  and  content  of  the  lesson.    Finally,  the  graphics  may 
also  facilitate  learning  if  they  are  used  to  give  feedback  after  the 
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learner  responds.    Again,  it  seems  intuitively  obvious  that  wrong  responses 
should  not  be  followed  by  "rewarding"  graphics  (although  informative  visual 
feedback  after  both  correct  and  wrong  answers  can  facilitate  learning). 
Part  Three;    Types  of  Graphics 

Instructional  pictures  have  been  classified  on  the  basis  of  how  they 
convey  meaning  including  representational,  analogical,  and  abstract 
(orarbitrary)  (Gropper,  1963 ;Knowl ton,  1966).    Research  studies  indicate 
that  each  of  the  three  types  facilitates  learning  (Alesandrini,  1984a; 
Levie  &  Lentz,  1982).    Yet  many  CAI  lessons  may  be  using  only  the  first 
type  of  graphics  when  pictures  are  used  at  all  (Alesandrini,  1984b).  (The 
terms  "pictures"  and  "graphics"  are  used  interchangeably  in  this  paper.) 
The  checklist  reflects  the  fact  that  each  of  the  three  types  may  be  used  to 
either  present  information  initially  or  give  informative  feedback  after  the 
learner  responds  to  questions  or  problems. 

Representational  Graphics.    Graphics  that  are  representational  have 
also  been  termed  "realistic"  (Knowlton,  1966)  because  the  category  refers 
to  pictures  that  are  isomorphic  with  the  objects  or  topics  that  they 
represent.    Graphics  in  this  category  may  vary,  however,  on  the  basis  of 
amount  of  realistic  detail  so  the  term  "representational"  is  less 
confusing.    In  courseware,  representational  graphics  include  line  drawings, 
shaded  drawings,  silhouettes,  and  realistic  symbols. 

i         Representational  pictures  can  either  portray  information  directly  or 
indirectly.    Tangible  objects  or  concepts  may  be  represented  directly. 
However,  it  is  not  always  obvious  how  to  portray  a  concept  that  has  no 
tangible  existence.    Although  abstract  concepts  cannot  be  directly 
portrayed,  they  may  be  portrayed  indirectly  by  showing  their  effects, 
results,  instances,  or  exemplars  (Gropper,  1963).    It  may  be  impossible  to 
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directly  portray  the  topic  of  "heat",  for  example,  but  its  effect  on 
solids,  liquids,  and  gasses  may  be  shown  via  melting,  boiling,  and  expan- 
sion of  gas-filled  objects,  respectively,    mother  approach  to  illustrating 
abstract  concepts  representationally  is  to  portray  a  concrete  associate  of 
the  concept  (Jones,  1983).    Seasons  of  the  year  may  be  portrayed  by  showing 
the  typical  dress  and  activities  of  people  during  that  season.  Some 
educators  have  made  up  pseudo-examples  that  portray  what  the  educator 
thinks  the  concept  might  look  like  if  it  were  tangible  (Cantu  &  Herron, 
1978). 

When  graphics  are  used  in  courseware,  they  are  typically 
representational.    This  type  of  graphics  appeared  in  40%  of  the  math 
lessons  surveyed,  71%  of  the  science  lessons,  25%  of  the  CAI  lessons  in 
language  arts,  and  21%  o^the  social  studies  lessons  (Alesandrini-,  3984b). 
Only  in  the  area  of  math  was  another  category  of  graphics  more  prevalent — 
namely,  abstract  graphics  such  as  charts  and  graphs.    In  all  areas  except 
social  studies  lessons,  representational  graphics  were  used  more  often  to 
present  information  tfcan  to  give  feedback  despite  the  evidence  that  visual 
feedback  can  facilitate  learning. 

Analogical  Graphics.    Another  category  of  graphics  has  been  termed 
analogical  because  the  concept  or  topic  is  conveyed  by  showing  something 
else  and  implying  a  similarity.    The  benefit  of  this  type  of  graphics  is 
based  on  the  assumption  that  new  information  will  be  better  learned  and 
remembered  if  it  can  be  related  to  prior  knowledge  (Reigeluth,  1983; 
Witt rock,  1974;  1977).    Studies  show  that  this  type  of  picture  can 
facilitate  learning  (Alesandrini,  1984a).    For  example,  visual  analogies 
have  been  used  to  facilitate  both  learning  (Mayer,  1975;  Royer  &  Cable, 
1976)  and  problem  solving  (Gick  &  Holyoak,  1983). 

Of  the  60  CBI  packages  surveyed,  none  made  use  of  analogical  graphics. 


Educators  should  be  concerned  if  they  find  a  total  lack  of  analogical 
graphics  since  theory  and  research  support  the  value  of  analogical  graphics 
in  CM,    Verbal  analogies  have  also  proven  facilitative  and  educators  may 
want  to  look  for  the  inclusion  of  verbal  analogies  in  a  CAI  lesson  if  no 
visual  analogies  are  present. 

Abstract  Graphics.    The  final  category  in  the  Checklist  is  abstract 
graphics  also  referred  to  as  arbitrary  or  logical  graphics.    These  visuals 
do  not  look  like  the  things  that  they  represent  but  are  related  abstractly 
or  conceptually.    Knowlton  (1966)  referred  to  this  type  of  picture  as 
"logical".    Abstract  graphics  include  graphs,  flowcharts ,  networks ,  maps 
tree  diagrams ,  and  other  schematized  charts  and  diagrams.    This  category  is 
very  useful  in  structuring  and  organizing  verbal  text.    Abstract  graphics 
can  be  used  to  facilitate  learning  when  no  other  type  of  picture  is 
possible  or  feasible.    Again,  research  results  support  the  value  of  this 
category  of  graphics  in  instruction  (Alesandrini,  1984a). 

Although  computers  are  well  suited  to  the  display  of  abstract  graphics 
since  this  type  of  visual  is  relatively  easy  for  the  instructional  designer 
to  create  via  computer,  few  CAI  lessons  surveyed  contained  abstract 
graphics.    Of  the  60  CAI  packages  surveyed,  only  13  (22%)  used  abstract  graph! 
of  any  kind  to  present  information.    Twelve  of  the  lessons  used"  abstract 
graphics  to  provide  informational  feedback  after  the  learner  responded.  Of 
the  13  lessons  that  used  abstract  graphics  to  present  information,  nine  ot 
the  lessons  were  in  the  area  of  mathematics.    None  of  the  lessons  in  social 
studies  used  this  type  of  visual.    Yet  flowcharts,  organizational  charts, 
tree  diagrams,  structural  networks,  and  hierarchical  maps  have  proven 
valuable  in  learning  from  text  (Moore  &  Readence,  1983),    It  appears  that 
CAI  lessons  could  do  much  better  in  taking  advantage  of  abstract  graphics. 
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Aii  Example  Application  of  the  Checklist 

The  Checklist  was  designed  to  provide  the  educator  with  some  general 
guidelines  for  determining  whether  a  CAI  lesson  is  using  instructional 
graphics  appropriately  and  fully.    It  serves  as  an  informal  means  of 
determining  the  instructional  value  of  a  CAI  lesson  based  on  its  use  of 
graphics.    The  Checklist  was  applied  to  two  different  CAI  lessons  that 
differed  considerably  in  their  use  of  graphics.    For  comparison  purposes, 
the  Checklist  was  quantified  by  scoring  all  items  checked  as  one  point 
except  for  items  1,  5f  and  10.    The  latter  three  items  are  negative 
characteristics  of  a  CAI  lesson  and.  therefore,  each  detracted  a  point  from 
the  score .    One  reason  the  Checklist  is  described  as  "informal"  is  that 
there  is  yet  no  evidence  regarding  the  relative  contribution  that  each 
characteristic  listed  on  the  checklist  makes  to  the  effectiveness  of  a  CAI 
lesson.    For  example,  we  don't  know  if  analogical  graphics  are  equally 
important  to  representational  graphics  or  if  one  or  the  other  type  should 
be  given  more  weight.    Since  no  data  is  available  regarding  relative 
contribution  of  these  factors  to  lesson  effectiveness,  all  positive 
characteristic  were  weighted  equally  in  determining  the  score.  Similarly, 
since  no  data* is  available  about  the  relative  detriment  of  the  negative 
characteristics,  they  were  weighted  equally  in  detracting  from  the  total 
score.    A  "perfect"  score  using  this  Checklist  would  be  14.  Three 
categories  were  arbitrarily  designated  as  follows:    Below  4,  Poor  Use  of 
Graphics;  5-9,  Good  Use  of  Graphics;  and  10-14,  Excellent  Use  of  Graphics. 

The  two  lessons  used  in  the  comparison  include  Green  Globs,  an  algebra 
plotting  game,  and  Dragon  Mix,  a  math  facts  game.    The  first  lesson  uses 
relevant  graphics  while  the  latter  uses  irrelevant  graphics  that  presumably 
make  the  lesson  fun     r  the  learner.    The  application  of  the  Checklist  to 
these  two  lessons  is  given  on  the  following  page  ("G"  stands  for  Green 
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Globs  and  "D"  for  Dragon  Mix).    The  Checklist  yielded  a  scors  of  11  for 
Green  Globs,  indicating  excellent  use  of  graphics,  compared  to  a  score  of  3 
for  Dragon  Mix,  indicating  poor  use  of  graphics.    It  should  be  noted  that 
each  of  the  lessons  may  have  numerous  other  favorable  or  negative 
characteristics  that  affect  their  usefulness  in  education.    However,  based 
on  the  application  of  this  checklist,  the  two  lessons  differ  considerably 
on  the  basis  of  their  effective  use  of  instructional  graphics. 

There  are  many  important  elements  of  lesson  evaluation  that  should  be 
considered  when  selecting  CAI  lessons  for  classroom  use.    This  paper 
discussed  the  contribution  of  instructional  graphics  to  effective  CAI  and 
presented  a  checklist  that  might  help  the  educator  determine  if  a  lesson  is 
making  good  use  of  graphics.    However,  the  Checklist  can  only  guide,  not 
decide.    It  is  left  to  the  educator  to  determine  if  a  particular  CAI  lesson 
is  appropriate  and  valuable  for  his  or  her  classroom. 
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Instructional  Graphics  Checklist 


Lesson  Title 


Publisher/Year 


Subject  Area/Level 


Please  check  each  characteristic  below  that  applies  to  the  lesson. 


Part  One. 

1. 

G  D 

2. 

b  V 

J. 

G  D 

4. 

Part 

Two. 

D 

5. 

G  D 

6. 

G 

7. 

G 

8. 

G  D 

9. 

D 

10. 

Part 

Threi 

11. 

12. 

G 

13. 

G 

14. 

G 

15. 

G 

16. 

Scoring:  Deduct  1  point  each  if  you  checked  items  1,  5,  or  10.  Add  1 
point  for  each  of  the  other  checked  items. 

Below  4s  Poor  5-9:    Good  10-14:  Excellent 
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Thia  etudy  contrasted  tht  off act  of  ty» ten- assigned  strategiee  for 
learning  concepts  with  etrategits  eelected  by  atodanta.  Subject-matter 
content  wae  baaad  on  a  aat  of  Imaginary  particlt  tyeteme  efmilar  to  atoms  or 
molecutee.   Tht  claaaif (cation  a/stem  conaiatad  of  18  Major  cattgor ita  and 
encompassed  approximately  200,900  uniqut  inatancaa. 

Treatments  were  implemented  by  a  computer  program  that  al lowed  students* 
to  txplort  tha  organization  of  tha  claaaif  i  cat  ion  ayataai  by  aalactlng  and 
viewing  paired  txajaplta  of  daf  inad  conctpta.    During  thia  tint  pariod, 
atodanta  racaivad  tha  atrategy  recommendations  which, represent  tht  treatment 
conditlona. 

In  tha  system-aeeigned  atrat»gy  treataent,  atodanta  Mara  provided  with 
strategiee  for  aalactlng  satchad  examples  and  non-exaMples  of  conctpta,  for 
rtMtMbering  concept  attributes,  and  for  reviewing  concept  definition*,  in 
the  atudent-aeelgned  atrategy  treatMent,  atudenta  rtcaived  non-directive 
placebo  inatructiona.   All  atrategy  instructions  were  free  of  references  to 
the  subject-Matter  content. 

Procadurea.    Student a  were  screened  from  tha  atudent  body  of  a 
continuation  high  school,  uatng  acorea  on  the  Widt -Range  Achleveajent  Teat 
<URAT>.    Those  with  a  grade-level  equivalent  of  at  Itaat  5.3  for  'math 
achievement  and  at  least  a.O  for  reading  were  aaKed  if  they  wished  to 
participate  in  the  experiment.   Volunteers  were  randomly  aaaigned  to 
treatment  group  a. 

Each  participant  completed  the  conditlona  subteat  of  the  Culture-Free 
Intelligence  Test*.    Scores  from  this  test  were  used  for  cover  lata  control  of 
prior  aptitude  for  concept  learning.   Verbal  Inatructiona  (bast 4. on  written 
protocol  a)  wore  used  to  orient  students  to  tha  computer  eystem  and  to 
introduce  prerequiaite  content  relating  to  the  terminology  of  the  imaginary 
particle  ayatems.    Students  Mere  also  shown  sample  items  from  the  posttett. 

Students  in  each  treatment  group  then  used  the  computer  system  to 
explore  the  Xenograde  concepts.    Syst Ma-assigned  learning  strategiea  and 
placebo  atrategiea  were  provided  to  the  respective  treatMent  groupa  at  at 
Measured  intervals  during  this  period. 

A  thirty-item  claaaif I  cat  I  on  test  aominiatered  iamedlately  following 
the  exploratory  station  served  as  a  Measure  of  concept  acquisition. 

Findings.    Scores  on  the  claaaif icat ion  test  were  subjected  to  an  - 
analysis  of  covariance  uaing  scorts  on  tht  Culture-Free  Intelligence  Test  aa 
a  control  for  prior  conceptual  ability.    Results  indicate  a  borderline 
treatwent  effect  <£  ■  3.55,  p.  ■  .07)  favoring  the  eyetem-aeaigned 
atrategiea.  • 
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The  Effect  of  8ystem-essigned  Learning  Strategics 
on  Acquisition  of  Coordinate  Concepts 

Brockenbrough  8.  Allan 
Educational  Technology  Program 
San  D.lego  State  Univarai  ty 

Effect  I vt  instructional  presentations  muet,  by  definition,  ; 
induce  mental  processes  that  result  in  "desired  performance. 
Conventional  approaches  to  instructional  design  usually  attempt 
to  Induce  the  necessary  mental  processing  through  cues  and  other 
stimuli  that  are  built  into  the  fabric  of  contend  presentations. 
The  content  is  Interlaced  with  elements  that  are  intended  to  get 
the  learner  to  think  about  the  material  in  helpful  ways.  Common 
examples  of  this  approach  include  repeating  or  paraphrasing  Kay 
points,  asking  .questions,  supplying  illustrative  diagrams  or 
pictures  and  providing  examples  or  analogies. 

Independent  learners — those  who  are  free  of  the  need  for 
Instruction— must 'be  able  to  induce  the  required  internal 
processing  on  their  own.    Presumably,  such  learners  can  select 
end  apply  appropriate  learning  strategies  without  help.  These 
learning  strategies  are  often  analogous  to  the  explicit 
representations  of  external  instruct! on i    paraphrasing  or 
repeating  to  oneself,  asking  and  answering  te If -generated 
questions,  forming  images,  generating  analogies  and  examples,  and 
so  on.    An  expert  learner  knows  which  of  these  Internal  processes 
will  be  effective  methods  for  mastering  the  required  skills  and 
knowledge. 

PlOTtl  fit  Instructional  Support.    But  what  kind  of  support 
is  required  by  learners  who  fall  short  of  such  expertise? 
Suppose,  for  example,  that  a  learner  already  knows  something 
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about  how  to  paraphrase  or  generate  an  i mag* ,  but  is  unci  tar 
about  which  technique  would  be  effective  for  a  given  learning 
task.    It  is  probably  unnecessary  (and  perhaps  even 

m 

counter-productive)  to  supply  learners  with  ready-made 
paraphrasings  or  images  when  they  are  already  capable  of 
generating  these  representations  internally.    A  more  appropriate 
method  may  be  to  assist  the  learner  in  selecting  the.  best  method 
for  a  particular  learning  task.    On  the  other  hand,  a  learner  who 
does  not  possess  strategies  appropriate  to  a  learning  task  is 
unlikely  to  profit  from  directions  to  use  such  unmastered 
skills. 

fiifiDJLZ'A  Emb#dd»d  JqjI  Detached  Strategies.     Rigney  (1978) 
has  described  a  convenient  framework  for  describing  instructional 
treatments.    He  draws  a  distinction  between  embedded  and  detached 
processing  strategies.     Embedded  processing  strategies  are 
reflected  in  the  actual  structure  of  an  instructional 
presentation,  in  that  they  encourage  or  require  the  learner  to 
process  information  in  certain  ways  in  order  to  work  through  the 
material.    A  student  might,  for  example,  be  asked  to  write  the 
answer  to  a  specific  question,  to  circle  part  of  a  diagram  or  to 
\^ write  a  short  paragraph  applying  new  knowledge  to  a  familiar 
personal  problem.     Detached  processing  strategies,  on  the  other 
hand,  are  independent  of  the  information  to  be  processed.  They 
represent  decisions  by  the  student  on  how  to  process  given 
information.     Detached  strategies  are  based  on  the  assumption 
that  the  student  has  some  latitude  in  selecting  task-relevant 
processing  ski  1  Is  from  a  set  of  previously  acquired  skills. 
Thu»,   in  reading  a  text  book,  a  student  might  employ  a  number  of 
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learning  strategies  by,  -for  exampl e ,  paraphrasing  a  passage  in 
his  or  her  own  words,  by  engaging  in  mental   imagery,  or  by 
relating  the  new  information  to  a  previously  encountered 
instance. 

Embedded  strategies  minimize  the  demands  on  the  student's 
internal  processing  ability  by  providing  the  processing  in 
external  -form  as  part  of  the  instructional  presentation,  while 
detached  strategies  presume  previous  acquisition  of  certain 
essential  processing  skills.    Many  instructional  systems  combine 
the  two  approaches — relying  on  the  student's  ability  to 
self -select  previously  acquired  processing  skills  for  some  phases 
of  the  instruction  and  providing  Cor  requiring)  specific 
processing  strategies  in  other  phases. 

Rigney  draws  an  additional  distinction — crucial  to  this 
discussion — between  system-ass 1  oned  detached  strategies  and 
student-ass toned  detached  strategies.    System-assigned  strategies 
involve  recommendation*  to  the  student  (by  the  instructional 
system)  on  when  to  apply  one  or  more  previously  acquired  learning 
skills.     Student-assigned  strategies  are  selected  by  the  student 
without  guidance  from  the  Instructional  system. 


A  learning  strategy  can  be  thought  of  as  a  cognitive  process 
that  is  specifically  directed  toward  the  acquisition  of  new 
information  or  skills.     Learning  strategies  may  be  distinguished 
from  instructional  strategies  in  that  they  represent  processes 
that  ere  lodged  Jjq.  the  1  earner .  rather  than  thost  which  are  based 
in  the  instructional  presentations. 


Learning  Strategies 
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Callahan  and  Merrill  <i980)  have  listed  some  of  the  learning 
strategies  -for  which  there  is  empirical  support.    These  include 
repetition,  paraphrasing,  creating  memorable  images,  generating 
or  recalling  examples,  asking  sel f -generated  questions, 
constructing  analogies,  and  so  on.     It  should  be  noted  here  that 
Rigney's  (1978>  embedded  treatments  cannot  in  themselves  be 
considered  learning  strategies  because  the  desired  processing  is 
done  for  the  student  by  the  instructional  presentation.    Each  of 
the  learning  strategies  cited  by  Callahan  and  Merrill  can, 
however,  be  represented  as  an  analogous  instructional  strategy  by 
making  the  process  explicit — by  repeating  material   for  the 
student,  for  example — or  by  providing  the  paraphrasing,  images, 
mnemonics,  examples,  questions,  or  analogies  in  external  form. 
The  analogous  nature  of  these  internal  and  external 
representations  of  processing  should  not  necessarily  imply  that 
they  rely  on  equivalent  cognitive  processes.    As  Neisser  (1976) 
points  out  in  the  case  of  imagery,  for  example,  construction  of 
images  from  memory  uses  processes  which  may  be  quite  difftrent 
from  perception  of  images  based  on  immediate  sensory  data. 

Based  on  the  work  of  Rigney  (1979),  Bovy  (1981)  and  Salomon 
(1979),  Allen  and  Merrill  <1984>  have  developed  a  model  for 
predicting  how  students  of  varying  aptitude  will  respond  to 
treatments  that  include  (or  omit)  recommendations  on  learning 
strategits.     Listed  in  the  order  below,  the  following  treatments 
reflect  an  increasing  reliance  on  the  student's  internal 
resources  for  processing  Informations 

1.     Treatments  that  provide  the  learner  with  explicit 

(external)  representations  (paraphrasi ngs,  questions, 
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exampl es,  analog!**  ttc.)  thereby  minimizing  the  need  for 
the  student  to  generate  his  cwn  representations. 

2.  Treatments  that  Qui  de  the  learner  in  selecting  and 
applying  previously  acquired  learning  strategies. 

3.  Treatments  that  IfjVf  Hut  student  free,  to  Ml  act  and 
apply  previously  acquired  learning  strategies  without 
external  suggestions  or  interference. 

The  model  predicts  that  students  with  low  aptitude  for  a 

learning  task  will  profit  most  from  the  first  type  of  treatment, 

that  students  of  moderate  aptitude  will  profit  most  from  the 

second  type,  and  that  students  of  high  aptitude  will  profit  most 

from  the  third  type  of  treatment. 

System  Assignment  of  Learning  Strategies 

The  unanswered  question  is  whether  an  instructional  system 
can  assume  the  role  of  guiding  the  student  to  select  (from 
previously  acquired  learning  strategies)  the  most  effective 
strategy  for  any  given  part  of  the  learning  task.     If  the  concept 
of  system-assignment  is  to  have  any  meaning,  such  guidance  must 
be  provided  while  the  student  is  actually  engaged  in  the  learning 
task}  otherwisey  the  student  is  using  a  student-assigned 
strategy. 

Allien  and  Merrill  (1984)  suggest  two  reasons  for  the 
predicted  effectiveness  of  system-assigned  learning  strategiesi 
(1)  an  'ncrease  in  working  memory  available  for  the  learning  task 
and  (2)  an  increase  in  the  relevance  of  learner's 
information-processing  strategies  to  the  performance  measure. 

Furthermore,  Allen  and  Merrill   (1984)  suggest  that  effective 
system-assigned  learning  strategies  must  meet  two  cr  i  ter  i 
First,  the  strategies  should  not  interfere  with  the  existing 
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learning  strategies  of  *  student  who  already  has  4  high  aptitude 
•for  the  learning  task  at  hand.    Recommending  strategies  to  auch  a 
student  entails  tha  risk  that  the  new  strategiea  will  compete 
with  methods  which  already  work.    As  Appal aci an  folk  wisdom  puts 
it,  "If  it  ain't  broke,  don't  fix  it." 

Second,  there  should  be  evidence  to  suggest  that  the  target 
population  haa  acquired  previously  a  set  of  learning  strategies 
(or  related  skills)  that  are  appropriate  to  the  learning  task. 
System-assigned  strategies  may  then  serve  to  gu:de  the  student  in 
selecting  the  most  appropriate  skill  for  a  given  part  of  the 
learning  task.    Since  system  assignment  is  defined  as  direction 
in  the  use  of  previously  acquired  processing  skills,  students  who 
V?ack  the  prerequisite  skills  cannot  be  expected  to  profit  from 
treatments  based  on  system-assignment. 

Studies  of  learning  strategiea  have  typically  veered  away 
from  investigation  of  system-assigned  treatments.     (See  for 
example  those  in  O'Neal,  1978. >  Instead,  researchtrs  have  focused 
on  providing  students  with  a  generalized  set  of  learning 
strategies  and  study  skills}  or  they  have  emphasized  validation 
of  a  specific  strategy  for  a  limited  task  environment.  Training 
in  learning  strategies  usually  attempts  to  cultivate  a  set  of 
general  strategies.     During  the  pretraining  phase,  the  student  is 
taught  to  use  several  types  of  learning  strategies.    Learners  may 
be  taught  how  to  select  and  apply  these  strategies,  or  it  may  be 
assumed  that  they  can  self-select  and  apply  the  appropriate 
strategies!  but  in  either  case,  the  selection  process  is  managed 
internally  by  the  student  during  the  actual   learning  task.  In 
short,  these  studies  are  based  on  cultivation  of  student-assigned 
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learning  strategies  rather  than  validation  of  system  assignment. 


This  study  attempts  to  demonstrate  the  feasibility  of 
guiding  moderate  aptitude  students  to  select  appropriate  learning 
strategies  while  they  are  learning  an  imaginary  classification 
system. 

System-assioned  Ex  stop 1 ar-comoar  i  son  strategies 

Al i  <1981)  has  reviewed  the  use  of  positive  and  negative 
examples  in  concept  teaching.    Ex amp l e/n on -ex ample  pairs  focus 
attention  on  the  critical  attributes  that  define  a  concept 
class.    When  a  system  of  related  concepts  is  being  learned,  the 
exemplars  of  one  concept  can  be  compared  with  the  exemplars  of 
other  concepts.     In  effect,  the  positive  examples  of  one  concept 
serve  as  negative  examples  of  other  concept  classes. 

Tennyson  and  Park  <1980)  note  that  the  explicit  comparison 
of  exemplars  is  frequently  recommended  as  an  instructional 
strategy.     In  Rigney's  terms,  such  explicit  comparisons  represent 
embedded  strategies  since  the  comparison*  are  provided  to  the 
student  by  the  instructional  system.    These  embedded 
exemplification  strategies  can,  however,  be  transformed  into 
equivalent  system-assigned  learning  strategies  by  providing  the 
student  with  recommendations  on  how  to  seltct  or  create 
exemplars.    Such  strategies  would  guide  the  student  in  selecting 
exemplars  (from  the  student's  own  memory  or  from  some  external 
pool  of  instances)  so  as  to  contrast  the  critical  attributes  that 
determine  membership  in  various  classes. 


Scooe  of  Study 
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Studen  t-aas i oned  strategist    srs  those  in  which  students  use 
their  own  preferred  method  -for  selecting  and  compering  exemplars. 

A  study  by  Callahan  and  Merrill  (1979)  provides  empirical 
evidence  to  support  the  feasibility  of  using  system-assigned 
exemplification  strategies  in  concept  teaching.    This  study 
involved  an  impoverished  learning  task  in  which  students  were 
deprived  of  an  adequate  number  of  system-supplied  (embedded) 
examples  of  a  set  of  def insd  concepts.    Under  these 
circumstances,  it  was  found  that  when  students  were  directed  to 
recall  previously  encountered  examples  of  the  concepts  from 
memory,  they  scored  higher  on  a  classification  test  than  did 
students  in  a  control  group  which  received  no  directions  to 
recall  examples  from  memory. 

In  Rigney's  terms,  this  study  compared  the  relative 
effectiveness  of  a  system-assigned  detached  strategy  with  a 
student-assigned  detached  strategy.    The  embedded  strategy  was 
not  included  as  a  treatment,  but  could  have  been  represented  by 
adding  an  additional  experiment  group  that  would  have  been  shown 
a  carefully  chosen  set  of  examples  illustrating  each  concept. 

The  learning  strategies  tested  in  this  current  study  extend 
the  work  of  Callahan  and  Merrill   in  two  ways.  The 
Cal 1 ahan-Merr i 1 1  treatment  guided  students  to  select  instances 
that  <1>  were  stored  in  the  student's  own  memory  (based  on 

> 

previous  experience)  and  (2)  served  as  positive  examples  of  the 
defined  concepts.    The  treatment  described  in  this  current  study 
guided  students  to  select  instances  which  (1)  were  stored  in  a 
computet  :zed  data  base  and  (2)  served  as  negative  and  positive 
examples  of  the  defined  concepts.    The  strategy  treatment  used  in 
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the  study  reported  here  Is,  therefore,  a  better  test  of  the 
feasibility  of  representing  the  exampie/non -example  prescription 
as  an  equivalent  system-ass igned  learning  strategy. 

.    Research  Question 
Can  system-assigned  strategies  enhance  concept  acquisition 
when  compared  to  student-assigned  strategies?    This  study's 
hypothesis  predicts  that  when  students  of  moderate  academic 
achievement  receive  system-assigned  learning  strategies,  they 
Hill  evidence  higher  scores  on  a  coordinate  concept 
classification  test  than  similar  students  who  rely  on 
self-selected  learning  strategies.    Rationalei    Students  of 
moderate  academic  aptitude  possess  previously  acquired  learning 
strategies  which  are  relevant  to  concept  acquisition  but  are 
independent  of  conceptual  ability.    These  moderate-aptitude 
students  will  thus  evidence  higher  scores  when  they  receive 
system  guidance  than  when  ti.ey  select  learning  strategies  on 
their  own. 

Terminology 

For  the  convenience  of  the  reader,  preceding  discussion  will 
be  summarized  as  a  set  of  construct  definitions.    These  in  turn 
serve  as  the  basis  of  experimental  variables. 

Conceptual  abilsitri     the  ability  to  recognize  and  remember 
new  concepts. \  ObviousXly  this  is  a  very  general  construct.  It 
was  measured  in\this  s/tudy  by  administering  the  conditions 

Fair  Intelligence  Test  (Institute  for 
i  ty  Testing,  1973) . 
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Coordinate  concent  cl assif ication  ttttt    *  problem  in  which 
the  student  must  classify  instances  according  to  a  system  of 
def i ntd  concepts  or  catagorias.    By  definition,  coordinate 
concepts  share  a  single  superordinate  class.  <Merril1  and 
Tennyson,  1978,  p.  144.)  The  task  required  of  the  student  in 
coordinate  concept  classification  problems  is  to  correctly 
identify  any  instance  with  the  name  of  the  most-narrowl y  defined 
concept  which  it  represents. 

Student -assigned  strategy i  -  a  learning  strategy  utilized  by 
the  student  without  system  guidance. 

System-ass i oned  strategy ■    As  used  in  this  study,  this  term 
refers  to  strategies  that  are  delivered  over  a  separate, 
independently  variable  information  channel — strategies  that 
exclude  specific  references  to  subject-matter  content.  Three 
system-assigned  strategies  were  used  in  this  study i 

1.  a  strategy  for  selecting  and  comparing  exemplars  from 
various  classes! 

2.  a  strategy  for  remembering  the  critical  attributes  of  each 
concept | 

3.  a  strategy  for  reviewing  concept  definitions. 

SubJect-matter  Content 
The  classification  scheme  used  in  this  study  is  loosely 
based  on  the  imaginary  science  of  Xenograde  Systems  (Merrill, 
1965).    As  implemented  in  this  current  extension  of  the  original 
Xenograde  "curriculum""  the  scheme  groups  Imaginary  particle 
systems  into  ten  classes  on  the  basis  of  the  type,  number  and 
behavior  of  various  sub-particles.     In  order  to  control  for 
rote-memory  effects,  the  names  of  the  classes  are  based  on  the 
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first  ttn  letter*  of  the  alphabet  <A1 phonic,  Be tonic,  Catatonic, 
etc.) 

Computer  Pi  mo  lay 

Manx  of  the  constructs  in  this  study  were  operat ional ized 
using  specially  designed  computer  displays  designed  by  the 
investigator  and  developed  by  his  associates  (Eucker,  Cochran, 
Allen  &  Merrill,  1982) •    These  programs  are  intended  as  a  general 
purpose  research  tool  for  investigating  instructional  design 
variables  related  to  concept  learning.    The  major  features  of  the 
system  are  outlined  below.  Complete  descriptions  can  be  found  in 
Eucker  et  al . 

The  programs  present  three  types  of  displays!  <1> 
definition  displays,  <2>  instance  selection  and  presentation 
displays,  and  <3>  item  displays  for  a  computer-administered 
classification  test. 

Definition  diaolars.      These  displays  present  a  brief 
definition  of  each  of  the  ten  Xenograde  Classes.  Class 
definitions  are  based  on  characteristics  such  as  the  number  of 
subpart icles  contained  within  a  system's  nucleus,  the  behavior  of 
subp articles,  the  number  of  satellites,  and  the  direction  of 
satellite  travel.    Other  attributes  such  as  nucleus  shape  are 
irrelevant  to  the  defined  classifications  and  art  varied 
automatically  by  the  computer  program  according  to  a  randomizing 
algorithm.    Each  display  summarizes  class  attributes — including 
some  that  are  irrelevant  to  identification  of  the  specific 
class.     Each  display  includes  an  example. 


ERIC 


»  X        '  50 


42 


Allen  Acquisition  of  Coordinate  Concepts — 12 

Cllitif ICltlOT  tftt  displays.    These  displays  constitute  the 
coordinate-concept  classification  test.  Each  display  requires  the 
student  to  identify  an  example  of  one  of  the  various  Xenograft 
dosses  by  selecting  the  appropriate  name  from  a  provided  list. 
Scores  on  this  test  served  as  the  dependent  variable  in  the 
experiment. 

IntUOtf  lfflfCtfOT  ADJl  presentation  display.  Taken 
together,  the  instance  selection  and  presentation  displays 
constitute  a  system  for  training  students  to  classify  specific 
instances  of  the  Xenograde  concepts.    These  displays  allow  for  a 
controlled  exploration  of  the  clams if icat ion  system.    The  student 
selects  the  attributes  she  or  he  wishes  to  have  included  in  a 
particular  instance.    She  or  he  is  free  to  create  examples  from 
any  of  the  ten  Xenograde  classes.    Once  the  attributes  have  been 
specified,  the  student  is  shown  a  diagram  of  the  instance  and  a 
summary  of  its  attributes.    The  system  allows  side-by-side 
comparison  of  two  different  instances,    at  one  time.    The  first 
instance  selected  is  labeled  "example"  by  the  systems  the  second 
instance  is  labeled  "comparison".    The  student  can  leave  the 
example  in  place  and  select  a  string  of  successive  comparisons, 
or  can  elect  to  start  a  new  "example"  at  any  time. 

Treatments 

As  previously  noted,  three  strategies  were  provided  in  the 
system-assigned  strategy  treatment.    These  orally-administered 
instructions  (summarized  below)  were  based  on  written  protocols. 

Strstffl/  fBL  tf ltctlng,  MSlSl  ccmoar tflfl  exemplars.     "Create  an 
example  of  any  class  you  want  to  learn  more  about.    Then,  follow 
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this  rule i    Always  c boost  two  comparisons  for  each  example. 
First,  choose  a  comparison  which  is  as  dlf f >r>nt  as  possible  from 
the  example,  but  still  from  the  same  class.    This  will  help  you 
to  learn  the  limits  of  the  class.    Then,  choose  a  comparison* 
which  is  as  simi lar  as  possible  to  the  example  but  from  a 
different  cjjukft-    This  will  help  you  to  see  the  difference 
between  classes."    These  instructions  were  repeated  in 
paraphrase,  form  and  a  card  with  a  bf>lef  summary  was  placed  in 
front  of  each  student  for  the  remainder  of  the  training  period. 

Strattor  iSC.  CtatBfatCinfl  concept  attributes!     -Imagine  that 
each  one  of  your  fingers  is  one  of  of  the  classes  .  .  .  put  the 
classes  in  some  kind  of  order  (10  second  pause)  .  .  .  imagine 
that  you  can  attach  the  special  traits  of  each  class  to  your 
fingers.    This  will  help  you  keep  the  classes  organized.  .   .  ." 

Strategy  for  reviewing  concept  definitional     ".   .   .  try  to 
create  an  example  from  each  one  of  the  10  classes." 
Student-assioned  Strategies  Treatment 

In  Rigney's  <1?78>  usage,  the  term  itudont-assi oned  refers 
to  strategies  selected  and  applied  according  to  the  student's  own 
predilections.    However,  in  order  to  control  for  factors  in  the 
system-assigned  strategy  treatment  that  might  involve  motivation 
or  reduction  in  t tme-on-task ,  placebo  "strategies"  were  provided 
to  subjects  receiving  the  student-assigned  strategy  treatment. 
These  placebos  were  similar  to  the  strategies  described  above, 
except  that  they  were  designed  to  be  as  non-directive  as 
possible.    The  placebo  method  for  selection  of  examples  and 
comparisons  was  merely  "...  try  to  identify  the  special  traits 
which  tell  each  class  from  all  the  rest  of  the  classes."  The 
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placebo  me  t  hod  for  rememb e r  ing  attributes  was  also  non-di rect i ve 1 


•  .  .  .  try  to  remember  the  special  traits  you ' ve  idant i f  i ed. ■ 
Tha  placebo  strategy  for  reviewing  concept  definitions  was  ".  .  . 
take  the  remaining  time  to  review  what  you/ve  learned." 


test  was  based  on  a  random  sample  of  the  content  domain.  The 
sampling  procedure  employed  a  computer  program  that  randomly 
selected  attribute  conditions  for  each  item.    A  30- i tern  test 
constructed  in  this  manner  was  piloted  on  a  population  of  college 
undergraduates  (n  -  25).    Using  Cronbach's  alpha  coefficient 
(Mar nans  and  Lehmann,  1979^  p.  99),   it  was  found  that  _  -  0.97. 


This  indicates  that  item  consistency  was  extremely  high,  in  spite 
of  the  homogeneity  of  the  subjects  and  the  small  sample  size. 


A  special  scoring  Key  was  developed  in  order  to  increase  the 
ability  of  the  test  to  measure  partial  acquisition  of  concept*. 
The  key  compares  given  responses  with  correct  responses.  Points 
are  assigned  for  each  item-response  on  tht  basis  of  the  number  of 
critical  attributes  shared  by  the  given  response  and  the  correct 
response.     Using  data  for  the  undergraduate  subjects,  scores 
adjusted  in  this  way  were  found  to  be  highly  correlated  with  raw 
scores,  r_  «  .96,  p.  <  .001. 

Measurement  flf  conceptual  abil i  ty.  Aptitude  for  concept 
learning  was  measured  using  the  "conditions"  subtest  of  .the 
Culture  Fair  Intelligence  Test  (Institute  for  Personality  and 
Ability  Testing,  1973,  Form  A,  Test  4).    The  total  Culture  Fair 
Test  correlates  moderately  well  with  other  measures  of 
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Intel  1  i  gencfTl  average  r_ ■«  .70  (I RAT,  p.  11).    Tht  test's 
technical  manual  cite*  several  studies  purporting  to  show  that 
scores  are  unaffected  by  cross-cultural  differences.  Interna! 
consistency  of  Form  A  items  was  listed  as  .76.    As  measured  in 
the  undergraduate  sample,  Cronbach's  alpha  for  the  conditions 
subtest  was  .69.    Validity  of  the  subtest  was  estimated  by 
correlating  subtest  scorts  with  performance  on  the 
coordinate-concept  classification  test  usin*  the  seme  sample  of 
students,  £  ■  .52. 


A  modified  Poet test-on 1 y  Control  Group  Design  (Campbell  & 
Stanley,  1963,  p.  29)  was  used  to  test  the  hypothesis. 

The  Xenograde  classification  test  served  as  the  post test. 


was  used  in  a  cover  I  ate  adjustment  of  classification  test 
(posttest)  scores. 

Subject  Selection 

Subjects.  Were  selected  from  the  student  body  of  a 
continuation  high  school   in  Southern  California  (N  m  329).  (This 
is  an  atypical  high  school  population.    According  to  school 
acini  ni  strators,  students  had  diverse  reasons — both  academic  and 
non-academic — for  interrupting  normal  high  school 
studies.)    Grade  level  equivalence  scores  on  the  Wide  Range 
Achievement  Test  (Guidance  Associates,  1976)  were  used  as  the 


criteria  for  selection.    Means  (and  standard  deviations)  of  the 


total  student  body  for  reading  and  mathematics  were  8.2  (1.96) 
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and  4.1  <1.99>  respectively.  The  selection  criteria  established 
by  the  investigator  required  that  a  student  have  a  minimum 
reading  score  of  6.0  and  a  minimum  math  score  of  5.3.  This 
resulted  in  a  pool  of  approximately  100  students.  The  number  of 
students  actually  participating  in  the  experiment  was  39.  Means 
(and  standard  deviations)  for  these  students  were  9.3  (1.39)  for 
reading,  and  6.9  (1.19)  for  math.  Distributions  for  both  scores 
were  approximately  normal. 

Assignment  to  Treatment  Brount 

A  computer  program  with  a  random  number  generator  was  used 
to  randomize  scheduling  of  treatments  during  available  school 
periods.    As  students  mere  located  and  recruited,  they  were 
assigned  to  a  specific  period  on  a  space-available  basis. 

Apparatus 

The  experiment    as  conducted  on  the  high  school  campus  in  an 
unused  classroom.    Three  Apple  II  computers  were  placed  in  study 
carrels.     Charts  summarizing  Xenograde  terminology  and  a  list  of 
definitions  of  the  Xenograde  classes  were  posted  on  the  walls  of 
each  carrel.    Verbal    instructions  were  administered  to  students 
over  headphones. 

Summary  of  Instructions  to  Subjects 

A  summary  of  directions  to  students  participating  in  the 
experiments  follows.     Important  directions  were  read  from  a  set 
of  written  protocols. 

Orientation.     Students  were  told  that  the  experiment  wac 
designed  to  see  if  it  was  possible  to  use  video  games  to  teach 
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people,  and  that  tht  video  game  they  would  play  involved  learning 
en  imaginary  science.    Students  were  informed  that  participation 
in  the  experiment  was  voluntary.  It  was  announced  that  the 
highest  scoring  student  amongst  all   the  participants  would  win  a 
S2S  cash  award. 

Terminology  and  definition  charts.    The  investigator 
directed  attention  to  the  charts  naming  the  parts  of  Xenograde 
systems  and  reviewed  each  of  the  terms. 

Pf f I n ill ons  fit  Xenoorade  classes.    The  students  were  guided 
through  the  definition  displays.    As  each  display  was  presented, 
the  investigator  read  the  definitions  of  Xenograde  classes  as 
they  appeared  on  the  screen.    Students  were  asked  to  note 
simil srities  and  differences  between  classes,  but  were  instructed 
not  to  try  to  memorize  the  definitions.     Students  were  also  told 
that  the  definitions  of  Xenograde  classes  posted  in  the  carrel 
would  be  removed  just  before  the  posttest. 


Preview  flf  classification  test.     Students  were  led  through  a 
portion  of  the  computer-administered  r 1 assi f i cat i on  test.  Tht 
investigator  read  the  text  of  the  displays,  showed  students  how 
to  start  the  test,  and  allowed  students  to  see  the  first  two 
items.     Students  were  reminded  that  they  would  be  able  to  see  ^he 
list  of  class  names  throughout  the  test  and  would  only  be 
required  to  supply  the  first  letter  of  the  appropriate  name  for 
each  i  tern. 

Orientation  to  instance  selection  and  presentation 
displays.     Students  were  oriented  to  the  use  of  the  instance 
selector  displays  and  instance  presentation  displays  through  & 
set  of  written  protocols  read  by  the  investigator. 
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Treatment  period.     Students  used  the  instance  selector  and 
instance  presentation  displays  for  40  minutes.  The 
system-assigned  and  student-assigned  (placebo)  strategy 
treatments  outlined  earlier  in  this  paper  were  administered  to 
the  respective  treatment  groups  during  this  period.  Strategies 
were  read  to  students  at  the  following  time  intervals  (measured 
from  the  start  of  the  period). 

10  minutest    strategy  for  selecting  end  comparing  exemplars 
30  minutest    strategy  for  remembering  concepts 
35  minutest    strategy  for  reviewing  concepts 

Classification  test.     Students  were  provided  with  an  answer 
sheet  and  were  instructed  to  begin  the  test. 

fritl  Analysis  and  Fjnqjings 
A  series  of  one-way  analysis  of  variance  procedures  (ANOUAs) 
was  used  to  check  for  possible  pretreatment  ability  differences 
between  the  experiment  groups.    No  significant  difference  was 
found  at  the  .01  level  for  reading,  math,  or  conceptual  ability. 

Comparison  of  Group  Means  for  the  Classification  Test 

Means  and  standard  deviations  on  the  Xenograde 
Classification  Test  for  the  two  groups  are  consistent  the 
hypothesis  that  system-assigned  strategies  can  improve 
acquisition  of  coordinate  concepts.    Means  (and  standard 
deviations)  are  as  -follows:  system-assigned  strategies,  46.6 
(24.0) ,  n  -  20 |  student-assigned  strategies,  33.8  (17.3),  n  = 
19. 
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An  analysis  of  cover iance  procedure  (ANCOMA)  was  used  to 
test  the  hypothesis  (Table  1).    The  difference  between  scores  for 
the  two  groups  approached  significance,  F  ( 1 ,  34 >  »  3.55, 
H  «  .07.    The  cover i ate  was  not  significant. 

Exploratory  Data  Analysis 

A  stepwise  regression  analysis  was  conducted  to  determine 
the  sources  of  error  variance  in  the  ANCOUAs.  Independent 
variables  included  conceptual  ability,  math  achievement  and 
reading  achievement.     Reading  and  math  ability  accounted  for 
nearly  half  of  the  variance  in  classification  test  scores, 
fi  -  -46,  F(2,32>  «  12.86,  ft  <  .01.    Attempts  to  use  math  and 
reading  ability  for  cover i ate  control  of  classification  scores 
did  not  result  in  higher  levels  of  significance. 

Cgrre lft jgn  S±  PotUtft  HSUh  Abil  ity  Measures  Correlations 
of  reading,  math,  and  pretest  scores  with  the  posttest  ranged 
from  r  -  .03  to  r  ■  -.06  and  were  not  significant  <p_  <  .10).  For 
the  purposes  of  this  study,  these  measures  may  therefore  be 
considered  orthogonal  variables. 

Table  2  displays  the  correlations  of  each  ability  measure 
with  the  posttest  scores  for  each  treatment  group.    This  data 
shows  a  moderate  and  significant  correlation  between  reading  and 
math  scores  and  posttest  scores. 

Inspection  of  the  table  reveals  apparent  differences  between 
the  ability  x  posttest  correlations  of  the  two  treatment  groups. 
This  possibility  was  tested  using  pairwise  comparisons  based  on 
Fischer's  Z  transformations  (Glass  &  Stanley,  1?70,  p.  311). 
Possible  contrasts  between  intra-group  correlations  were 
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separately  tested  for  reading,  math  and  posttest  score*.    All  but 
on*  of  these  comparisons  lacked  significance  at  the  .10  level. 
The  exception  involved  correlation  of  math  scores  on  the  WRAT 
with  performance  on  the  classification  testi  System-assigned 
<£.  -  .72).  vs.  student-assigned  <r_  ■  .23).  £  -  1.8?,  ft.  -  .06. 

In  other  words,  there  was  a  high  correlation  between  math 
achievement  and  concept  acquisition  among  students  who  received 
the  system-assigned  strategies  and  a  low  correlation  between  math 
achievement  and  concept  acquisition  among  students  who  used  their 
own  strategies.    Although  this  is  a  borderline  effect,  it 
suggests  that  the  effect  of  the  system-assigned  strategies  was 
positively  influenced  by  pretreatment  mathematics  ability. 


The  direction  of  differences  between  group  means  is 
consistent  with  the  hypothesis  that  system-assigned  strategies 
can  enhance  acquisition  of  coordinate  concepts.    The  comparison 
between  the  two  treatment  groups  approached  significance  at  the 
.05  level.     Regression  analysis  demonstrated  that  nearly  half  of 
the  error  variance  can  be  attributed  to  differences  in  math  and 
reading  ability.    Most  of  the  remaining  error  variance  was 
probably  due  to  unmeasured  differences  in  cognitive  ability. 

Generalizing  these  tentative  findings  is  a  two-sided  issue. 
On  one  hand,  the  use  of  an  atypical  group  of  students  from  a 
continuation  high  school  argues  against  generalizing  results  to 
the  other  high  school  populations.     On/  the  other  hand,  the 
detection  of  a  borderline  effect  in  /  group  with  diverse  reasons 
for  failure  in  ordinary  school  settings  should  engender  some 
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confidence  that  the  txptrimtnt  could  be  repeated  with  significant 
results*   if  a  normal  group  of  high  school  students  wire  used. 

Math  as  a  Task-relevant  Aptitude 

Differences  in  the  math  X  classification  test  correlations 
for  students  receiving  system-assigned  strategies  and  those 
relying  on  sel f -selected  strategies  suggests  that  moderate  levels 
of  ability  in  mathematics  was  a  requirement  for  successful 
adoption  of  the  system-assigned  strategies.    This  is  not 
surprising  since  the  the  recommended  strategy  for  selecting 
examples  and  comparisons  was  stated  in  terms  that  required  an 
ability  to  think  in  logical   terms  about  set  relationships. 

The  positive  influence  of  mathematics  ability  on  posttest 
performance  also  provides  indirect  support  for  the  global  model 
proposed  by  Allen  and  Merrill  <i?84>.    The  global  model  predicts 
that  system-assignment  will  be  less  effective  than 
student -assignment  for  students  with  high  aptitude,  and  less 
effective  than  embedding  for  students  with  low  aptitude.  The 
hypothesis  that  system-assigned  learning  strategies  would  enhance 
concept  acquisition  was  therefore  dependent  on  the  crucial 
stipulation  that  the  task-relevant  skills  of  students  be 
moderately  strong.     Due  to  the  small  pool  of  potential  subjects, 
the  investigator  was  forced  to  violate  this  important 
stipulation.     Of  the  participating  high  school  students,  67 
percent  had  math  achievement  scores  that  were  below  the 
seventh-grade  level.     It   is  likely,  therefore,  that 
system-assignment  was  an  inappropriate  method  for  many  of  the 
experiment  subjects  and  that  embedded  strategies  (such  as  fne 
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that  explicitly  compared  matched  example/non-exampl e  pairs)  would 
have  bean  a  mora  effective  treatment  for  these  student*. 
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Table  1 
Analysis  of  Covar  tanct 
Systen-ass igntd  vs.  Student -ass igntd  Strategies 


H5 

£ 

ft 

Covar  iate 
Conctptal  Ability 

1 

34.1 

.08 

.8 

Between  Group 

\ 

1973.2 

3.55 

'  .07 

Explained 

2 

804.4 

1.81 

.18 

Table  2 

Correlation  of  Student  Ability  with 
Classification  Performance 


Group 


Conceptual    Reading  Hath 
Ability        Achievement  Achievement 


System-assigned  20 
strategy 

Student-assigned  19 
strategy 
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2 

Abstract 

Research  examining  the  contribution  of  pictures  to  young  children's 
recall  of  prose  materials  suggests  that  pictures  can  be  used  to 
facilitate  the  recall  of  Information  presented  in  prose  passages. 
Can  positive  effects  found  with  young  children  be  extended  to  older 
learners?   If  picture  effects  are  present,  are  they  durable  over 
time?   Data  collected  from  two  experiments  including  college 
students  provide  evidence  for  an  affirmative  answer  to  both 
questions. 


66 
59 


Pictures  and  Recall 

3 


Prose-Relevant  Pictures  and  Older  Learners' 
Recall  of  Written  Prose 

There  1s  now  substantial  evidence  that  pictures  can  be  used 
to  facilitate  the  recall  of  Information  presented  1n  prose  ^ 
materials,    Levle  and  Lentz  (1982)*  1n  a  major  review,  concluded 
that  "when  Illustrations  provide  text- redundant  Information, 
learning  Information  1n  the  text  that  1s  also  :hown  1n  pictures 
will  be  facilitated"  (p.  225).    The  reviewers  reported  that  the 
average  Improvement  was  36%  for  groups  reading  with  pictures  1n 
comparison  to  groups  reading  text  alone.   Most  studies  reported  1n 
the  literature  Investigating  the  contribution  of  pictures  to  prose 
learning  have  used  younger  learners  (grades  K-6)  as  subjects 
(Alesandrlnl,  1984;    Levle  &  Lentz,  1982;  Levin,  1981;  Levin  & 
Lesgold,  1978).    In  the  Levle  and  Lentz  review,  23  studies  examined 
learning  Illustrated  text  Information.    Of  these  23,  only  three 
Included  more  mature  learners  (I.e.,  post- secondary  school 
learners)  as  subjects.   Additional  studies  with  older  learners  are 
needed  1n  order  to  determine  1f  the  results  with  young  children  can 
be  generalized  to  other  audiences. 

This  study  Investigated  the  possible  contribution  of 
prose-relevant  pictures  to  the  recall  and  retention  of  Information 
presented  1n  written  prose  materials  with  older  learners  as 
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subjects.   The  first  variable  considered  1n  this  Investigation  was 
the  extension  of  the  positive  picture  effects  found  with  young 
children  to  college-age  students.   The  second  variable  considered 
the  durability  of  the  picture  effects.   Peng  and  Levin  (1979) 
suggested  that  "1n  order  to  prove  Implications  for  classroom 
learning  situations,  1t  must  be  demonstrated  that  gains 

r' 

attributable  to  pictures  are  not  short-lived8   (p.  35).  The 
durability  of  picture  effects  with  second  and  fourth  graders  over  a 
3-day  period  has  been  demonstrated  (Levin  &  Berry,  1980;  Peng  & 
Levin,  1979). 

In  this  study  two  experiments  using  older  students  as 
subjects  were  conducted.    In  the  first  experiment,  recall  of 
Information  presented  1n  written  prose  materials  was  assessed 
immediately  following  presentation  of  a  prose-plus-picture  passage 
(or  prose-only  passage)  and  14  days  later.    The  second  experiment 
was  similar  to  the  first  but  the  delayed  test  was  administered  26 
days  following  the  Immediate  test. 

Experiment  1 

Method 

Subjects  and  Design.    Fifty- two  graduate  students  from  a 
southeastern  university  were  randomly  assigned  to  either  a 
prose-plus-picture  (27  subjects)  or  prose-only  (25  subjects) 
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group.    In  the  prose-pi us-p1cture  condition,  the  students  read  the 
prose  passages  and  viewed  the  accompanying  pictures.    In  the 
prose-only  condition  the  subjects  read  the  prose  passages  without 
the  pictures. 

Materials.    Three  human  Interest  stories  were  chosen  from 
Time,  a  weekly  news  magazine.    The  passages  were  approximately 
one-half  to  three  quarters  of  a  page  1n  length,  typed  and 
double-spaced.   One  article  described  an  Individual  who  had  set  up 
residence  on  a  traffic  Island  on  Manhattan.    Another  was  about 
skateboarding  1n  Madison,  Wisconsin,  and  a  third  described  e 
neighborhood's  solution  to  waiting  1n  long  lines  so  that  their 
children  could  see  Santa  Claus  1n  a  department  store. 

For  each  passage,  a  slrgle,  8  and  1/2  by  ll-1nch  Hne  drawing 
was  produced  to  represent  or  duplicate  the  passage  Information. 
Levin  (1981)  has  described  the  representation  function  of  pictures 
as  that  of  making  the  prose  passage  more  concrete.    The  picture  was 
presented  on  the  page  following  the  prose  passage.    The  picture 
u^ed  for  the  traffic  island  passage  1s  presented  1n  Fir-jre  1. 


Insert  Figure  1  about  here 


Five  snort-answer  paraphrase  questions  were  constructed  for 
each  passage  using  Anderson's  (1972)  recommendations.  The 
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questions  tested  recall  o.  information  that  was  presented  1n  the 
passage  and  specifically  pictured.   The  five  test  questions  for 
each  passage  were  reproduced  on  three  separate  pages.   The  title  of 
the  passage  appeared  at  the  top  of  the  appropriate  test.    Prior  to 
Experiment  1,  the  15- Item  test  was  administered  to  a  group  of  16 
graduate  students  to  verify* that  subjects  would  not  be  able  to 
answer  correctly  the  questions  without  reading  the  prose  passages 
and/or  viewing  the  pictures.    Average  recall  for  the  16  graduate 
students  was  3%. 

Procedure.    The  treatments  were  administered  in  a  group 
format.    Instructions  were  printed  on  the  cover  sheet  accompany* ng 
each  of  the  three  prose  passages  (and  pictures  If  appropriate). 
Subjects  1n  the  prosie-plus-plcture  group  were  Instructed  to  read 
the  passage  and  view  the  accompanying  picture  once.  Prose-only 
subjects  were  Instructed  to  read  the  passage  once.    Subjects  read 
the  material  at  their  own  pace.    Subjects  were  asked  to  raise  their 
hand  when  they  had  completed  the  task.    The  experlmentor  collected 
the  instructional  treatment  and  administered  the  appropriate  5-1tem 
test.    A  similar  procedure  was  used  for  passages  two  and-  three. 
Fourteen  days  later  the  students  were  tested  1n  the  same  manner, 
with  the  same  l5-1tem  test  as  used  in  the  immediate  condition  (five 
items  per  passage). 
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Results  and  Discussion 

After  Experiment  1  was  completed,  a  problem  was  Identified 
with  regard  to  one  of  the  15  test  Items.    Based  on.  Information 
presented  1n  the  prose  passage,  more  than  one  correct  response  was 
possible.    As  a  result,  the  Item  was  deleted  from  the  analysis.  * 

The  first  analysis  compared  the  prose-plus-picture  group  with 
the  prose-only  group  for  the  Immediate  and  delayed  testing 
conditions.    One-tailed  significance  tests  were  used  based  on  the 
direction  of  differences  found  1n  previous  studies  with  young 

children  and  the  limited  number  of  studies  done  with  adults.    In  • 

I 

the  Immediate  testing  condition,  the  average  recall  of 
prose-plus-plcture  subjects  (88%)  was  significantly  higher  than 
that  of  control  subjects  (75%) ,  t  (50)^=  4.00,  jK.001  (one- 
tailed).    For  the  14-day  delayed  testing  condition  the  average 
recall  of  prose-plus-picture  subjects  (87%)  was  also  significantly 
higher  than  that  of  prose-only  subjects  (71%),  t  (50)  =  4.96, 
£<.001  (one- tailed). 

The  second  analysis  was  performed  to  determine  if  a 
significant  amount  of  information  was  lost  over  the  14-day  delay 
for  both  the  prose-plus-picture  and  prose-only  groups. 
Prost-plus-picture  subjects*  average  recall  of  Information  in  the 
immediate  (88%)  and  delayed  (87%)  conditions  was  not 
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statistically  different,  lt»<l.    In  the  prose-only  condition,  the 
average  recall  for  subjects  was  75*  and  71X  for  the  Immediate  and 
delayed  testing  conditions,  respectively.    When  subjected  to  a 
paired  t-test  this  difference  was  significant  (t(24)  »  2.12,  £<.05 
(two-tailed)).    Picture  effects  were  observed  1n  the  immediate  and 
14-day  delay  conditions  while  a  significant  amount  of  Information 
was  lost  over  time  only  1n  the  prose-only  group. 

Experiment  2 

The  second  experiment  was  conducted  to  determine  1f  the 
results  observed  1n  experiment  1  would  be  similar  If  the  time 
between  administration  of  the  treatments  and  the  delayed  test  was 
extended5.?  Materials,  methods  and  procedures  were  similar  to 
Experiment  1  but  the  time  between  the  Immediate  and  delayed  test 
was  extended  to  26  days. 
Method 

Subjects  and  Design.    A  different  group  of  forty-seven 
graduate  students  from  the  same  southeastern  university  as  subjects 
in  Experiment  1  were  randomly  assigned  to  prose-plus-picture  (22 
subjects)  and  prose-only  (25  subjects)  groups.    As  in  Experiment  1, 
students  in  the  prose-plus-picture  condition  read  the  prose 
passages  and  viewed  the  accompanying  pictures.    In  the  prose-only 
condition,  subjects  read  the  prose  passages  without  pictures. 


72 
65 


Pictures  and  Recall 

Materials.    The  prose  passages  and  pictures  used  1n 
Experiment  1  were  also  used  1n  Experiment  2  (three  passages,  three 
pictures).    In  addition,  the  same  15-1 tem  test  was  used.    The  one 
problematic  Item  observed  1n  Experiment  1  was  rewritten. 

Procedure.    The  treatments  were  administered  1n  the  same 
manner  as  they  were  for  the  first  experiment.    Testing  was  done 
Immediately  following  completion  of  the  treatments  and  26  days^ 
following  the  administration  of  the  treatments. 
Results  and  Discussion 

Significant  picture  effects  were  Identified  1n  both  the 
immediate  and  delayed  testing  conditions.    In  the  Immediate  testing 
condition,  the  average  recall  of  prose-plus-p .cture  subjects  (89%) 
was  significantly  higher  thar  that  of  prose-only  subjects  (79%), 
t(45)  =  3.60,  £<.001  (one-tailed).    For  the  delayed  testing 
condition  (26-day  delay)  the  average  recall  of  prose-plus-picture 
subjects  (75%)  was  also  significantly  higher  than  that  of 
prose-only  subjects  (61%),  t(45)  =  3.91,  p_<.001  (one-tailed). 
Average  recall  was  lower  for  both  groups  in  the  delayed  testing 
condition.    Prose-plus-p1cture  subjects'  average  recall  in  the 
\  Immediate  (89%)  and  delayed  (75%)  conditions  was  statistically 

different,  paired  t(21)  *  9.01,  £<.001,  two-tailed.  Prose-only 
subjects'  average  recall  1n  the  immediate  (79%)  and  {delayed  (61%) 
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conditions  was  also  statistically  different,  paired  t( 24)  «  9.58, 
jK.001,  two- tailed.  Picture  effects  were  durable  over  the  26-day 
dela>,  but  both  groups  lost  a  significant  amount  of  Information. 

General  Discussion 
Results  of  this  study  support  the  claim  that  prose- relevant 
pictures  do  contribute  to  older  learners*  Increased  recall  of  prose 
materials.    In  two  experiments,  graduate  students  who  read  prose 
passages  and  viewed  accompanying  pictures  remembered  more  of  the 
Information  .that  was  pictured  and  Included  1n  the  prose  passages 
than  those  students  who  read  the  same  prose  passages  without  the 
pictures.    Facll 1tat1ve  picture  effects  were  observed  1n  both 
Immediate  and  delayed  (Experiment  1,  14-day  delay;  Experiment  2, 
26-day  delay)  testing  conditions.    The  prose-plus-plcture  groups 
retained  more  Information  over  the  14-day  (Experiment  1)  and  26-day 
(Experiment  2)  delays  than  the  prose-only  group.    In  the  14-day 
delay  condition  the  prose-plus-picture  group,  1n  contrast  to  the 
prose-only  group,  did  not  lose  a  significant  amount  of. 
information.    While  both  the  prose-plus-picture  and  prose-only 
groups'  average  recall  was  significantly  lower  for  the  26-day 
delayed  testing  condition  (Experiment  2)  than  1n  the  Immediate 
testing  condition,  the  difference  between  the  average  recall  of 
prose-plus-picture  subjects  and  prose-cnly  subjects  Increased. 
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Levin  (1981)  has  argued  that  subjects'  Increased  recall  1n 
prose-pi us-p1cture  conditions  1n  contrast  to  prose-only  conditions 
may  be  due  to  greater  memory  trace  strength  1n  the  prose-plus- 
picture  condition.   He  stated,  "According  to  the  representation 
function,  pictures  lay  down  a  'memory  trace'  that  ...  1s  stronger 
than  that  associated  with  a  strict  verbal  representation  of  the 
text"    (Levin,  1981,  pp.  214-215). 

Findings  of  the  current  study  are  consistent  with. studies 
reported  by  Levin  and  Berry  (1980)  and  Peng  and  Levin  (1979),  1n 
which  the  subjects  were  children  and  prose  passages  Included  human 
Interest  and  novelty  stories.    In  the  current  Investigation  average 
recall  for  prose-plus-plcture  subjects  was  10X-16X  higher  than  that 
of  prose-only  subjects.    Levin  and  Berry  and  Peng  and  Levin 
reported  similar  results  (13X-20*).    In  both  the  Levin  and  Berry 
and  Peng  and  Levin  studies,  representational  pictures  were  used  In 
the  picture  conditions. 

The  magnitude  of  the  picture  effects  observed  1n  this  study 
were  lower  than  the  average  Improvement  (36X)  reported  by  Levle  and 
Lentz  (1982).    This  lower  average  Improvement  may  be  due  to  celling 
^effects  present  1n  both  experiments.    In  Experiment  1, 
prose-plus-plcture  subjects'  average  recall  of  Information  1n  the 
immediate  and  delayed  testing  conditions  was  88*  and  87%, 
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respectively.    Similar  celling  effects  were  observed  1n  Experiment 
2.   Alternatively,  some  of  the  pictures  Included  1n  the  23  studies 
reviewed  by  Levle  and  lentz  may  not  have  functioned  as 
representational  pictures  using  Levins'  (1981)  definition.  . 
Finally,  as  Levin  and  Perry  (1980)  have  suggested,  the  particular 
type  of  prose  passages  (human  interest  stories)  may  have  affected 

« 

the  size  of  the  picture  effects. 

Can  positive  picture  effects  found  with  young  children  be 
extended  to  older  learners?    If  found,  are  the  positive  picture 
effects  durable  over  time?   Results  from  this  study  provided 
support  for  an  affirmative  answer  to  both  questions.  Further 
extension  of  the  findings  to  other  audiences,  for  example,  adult 
learners  who  are  not  Involved  1n  formal  school  settings,  1s 
needed.    The  limits  of  the  durability  of  positive  picture  effects 
warrants  further  study.    If  Individuals,  1n  fact,  can  remember  more 
information  over  extended  periods  of  time  reading  prose  with 
\       pictures,  then  these  results  would  have  practical  Implications  for 
educators,  Instructional  designers  and  others  Involved  1n  the 
educational  process. 
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Figure  1.  Picture  Accompanying  One  of  the  Prose  Passage*  in 
Experimental  Condition. 
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Reader  Theories,  Cognitive  Theories  and  Educational  Media  Research 

This  paper  is  the  introduction  to  an  inquiry  into  the  relation- 
ship of  post  structural  reader  theories  to  cognitive  theories  in  the 
study  of  educational  media.    This  inquiry  will  define  some  basic 
concepts  in  reader  (Harari,  1979)  and  cognitive  theories,  and  des- 
cribe their  similarities  and  differences.    It  will  reccanuend  applica- 
tion for  media  research  in  the  separate  paradigms  from  which  these 
theories  emerge.    My  presentation  today  represents  only  the  first 
portion  of  this  larger  inquiry. 

Explanations  for  learning  when  instructional  media  are  employed 
in  an  educational  setting  have  traditionally  drawn  upon  a  behavioral 
model.    Current  research  and  theory  in  instructional  technology  in- 
dicate the  limitations  of  such  a  model  and  the  difficulty,  in 
general,  of  assessing  the  effects  of  a  medium.    Exploration  of  cogni- 
tive theories  has  recently  provided  researchers  with  a  more  elegant 
explanation  of  learning.    In  fact,  the  power  of  these  theories  to 

inform  the  construction  of  learning  models,  such  as  the  prepositional 
model,  is  great  and  far  from  exhausted.    Cognitive  theories,  however, 
assume  a  psychological  explanation  for  learning  which  emphasizes  in- 
dividual mental  functions  and  considers  the  individual  as  a  unit. 
While  this  approach  is  a  time  honored  one  and  necessary  in  educa- 
tional research,  there  is  another  approach  to  learning  that  is  not 
often  employed  in  this  field.    That  approach  is  a  structural  one. 

Disciplines,  such  as  biology,  zoology,  anthropology,  sociology 
and  communication  arts,  to  mention  a  few,  inquire  about  the  nature 
of  human  behavior.    Investigators  in  these  fields  employ  psychological 
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and  social  models  for  explanations  of  behavior  and  a  description  of 
interaction.    Psychological  and  social  models  exi't  side  by  side, 
albeit  not  always  peacefully,  within  these  disciplines.    In  fact,  it 
is  the  debate  between  proponents  of  these  diverse  models  which 
helps  elaborate  the  description  of  human  behavior. 

An  educational  investigator  working  within  the  psychological 
model  might  ask  the  question,  "How  does  a  viewer  learn  from  a  pre- 
sentation?"; while  an  investigator  employing  a  social  model  might  asjc, 
"I low  do    viewers  derive  meaning  from  a  presentation?".    Yet  the 
latter  question  does  not  vitiate  the  former.    They  may  in  fact  be 
considered  complementary  since  educational  research  deals  with 
social,  psychological  human  beings.  The  former  question  constructs 
the  viewer  in  a  psychological  form,  while  the  latter  constructs  the 
viewer  in  a  social  mode.    The  dichtomy  persists  even  though  post 
structural  reader  theories  appropriate  psychoanalytic  theories, 
such  as  those  of  Freud  and  Lacan  (Harari,  1974)  to  partially  con- 
struct the  viewer.    The  difference  resides  in  the  dichitomous 
application  of  psychoanalytic  theory  within  the  two  paradigms.  A 
cognitive  paradigm  applies  these  theories  to  explain  learning  and 
brain  functions  where  the  brain  of  the  viewer  is  considered  as  a 
unit.    Structural  and  post  structural  theories,  however,  focus  on 
the  viewer  as  a  member  of  a  social  group  historically  and  at  a  moment 
in  time.    These  theories  appropriate  psychoanalysis  to  partially  ex- 
plain how  a  viewer  creates  meaning. 

One  method  of  approaching  the  question,  "How  does  a  viewei 
derive  meaning?"  is  the  application  of  structural  analysis. 


\ 


3 


Loosely  conceived,  structuralism  is  a  way  of  thinking  about  the 
world  which  is  predominantly  concerned  with  perception  and  the 
description  of  structures.    This  notion  of  structuralism,  then, 
would  include  researchers  working  in  many  disciplines  under  varying 
paradigms.    Piaget,  for  example,  working  within  the  cognitive 
paradigm  would  be  called  a  structuralist,  since  he  describes  and 
works  with  structure.    Loosely  conceived,  a  new  form  of  behaviorism, 
sociobiology,  would  be  considered  a  structural  theory,  because  its 
proponents  study  the  social  interaction  of  animals. 


More  strictly  conceived,  nowever,  structuralism  provides  a 
framework  for  organizing  and  orienting  any  study  concerned  with  the 
production  and  perception  of  meaning.    It  focuses  on  those  human  acts 
or  behaviors  that  involve  cultural  construction  the  way  that  speech 
acts  involve  sentences.    It  is  this  notion  of  structuralism  which 
provides  a  rich  framework  within  which  to  examine  media  viewers  and 
their  social  knowledge. 

It  is  important,  here,  to  understand  some  basic  concepts  of 
the  more  narrowly  defined  structuralism.    This  theory  talks  about 
the  concept  and  perception  of  meaning  rather  than  the  concept  of 
learning.    "Meaning",  here,  is  that  which,  one  intends  to  convey  by 
a  human  act,  especially  language.    "Meaning"  may  be  an  act  signified 
by  language.    In  this  theory  knowledge  accrues  by  perception  of 
meaning,  not  by  information  processing,  nor  the  acquisition  of  a 
skill,  nor  the  construction  of  strategies  of  knowledge.  Structurally 
conceived,  the  relationship  between  the  observer  and  the  observed 
becomes  primary.    Knowledge,  here,  resides  in  the  relationships 
which  people, construct  and  then  perceive. 
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Semiotic  analysis  was  the  first  form  of  structuralism  (before 
Levi  Strauss)  which  offered  a  model  to  decode  linguistic  and  media 
texts.    While  this  analysis  focused  on  the  structure  of  a  film  or 
television  presentation  and  the  embedding  of  messages  within  the 
form  of  the  medium,  it  failed  to  consider  the  interaction  of  the 
viewer  with  the  medium.    Employing  the  same  basic  structural  pre- 
mises, post  structural  investigators  have  suggested  models  of 
analyses  which  include  the  viewer  and  his/her  perceptions.  Such 
theories  are  currently  called  reader  theories,  theory  of  the  sub- 
ject, and  deconstruct ion  theories.    The  inclusion  of  the  reader 
or  viewer  in  the  structuralist  equation  brings  the  model  closer 
in  form  to  cognitive  learning  theories. 

.    What,  if  any,  are  the  similarities  between  post  structural 
reader  theories  and  cognitive  learning  theories?    Are  they  only 
dichotomous?    Can  they  both  contribute  in  a  complementary  fashion, 
to  the  elaboration  of  our  concept  uf  learning  and  media?    I  will 
attempt  to  partially  explore  that  relationship  here.    Within  the 
behavioral  paradigm,  educational  researchers  were  interested  in 
the  learner  and  learning".    The  learner  was  defined  as  someone  who 
responded  to  a  stimulus  and  who  was  active.    It  appears  that  action 
within  this  paradigm  simply  meant  outward  motion,  because  the 
observation  of  outward  mot      was  the  o.aiy  way  one  could  evaluate 
learning  or      ;  >nse  to  a  stimulus.    Outward  motion  could  include 
a  pencil  r»_.     r.e  to  a  verbal  question.    The  idea  of  action,  then 
was  simply  that  it  was  reaction,  not  action  motivated  by  intention 
nor  coming  from  within.    Within  the  behavioral  paradigm  the  learner 
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was  said  to  learn  by  engaging  in  repeated  trials  of  the  behavior  to 
be  learned,  by  the  application  of  reinforcement  to  the  practice  of 
the  behavior,  by  the  presence  of  cues  and  prompts  and  the  fading  of 
such.    It  is  not  the  purpose  of  this  paper  to  mount  an  argument 
against  the  behavioral  paradigm  and  the  definition  of  learning  or 
the  learner  within  that  paradigm,  but  simply  to  evoke  the  old  de- 
finitions for  purposes  of  comparison  with  the  new  definitions  in 
the  cognitive  paradigm.    As  we  are  now  aware, i  paradigm  shift  is 
occuring  within  the  field  of  educational  technology  (Clark  and 
Salomon,  19851  and  has  occurred  within  the  area  of  educational 
research  in  general.    (Witt rock,  1978,  We ins te in  and  Underwood, 
1983,  and  Diekhoff  and  Diekhoff,  1982).    These  shifts  have  aJ#o 
affected  instructional  design  and  development  (Foshay,.  1983,  Terrell, 
1983)  which  area,  to  date,  has  been  articulated  with  exquisite  de- 
tail along  behavioral  lines.    Perhaps  tTiis  articulation  is  the  rea- 
son why  many  academics,  unfortunately ,  do  not  take  instructional 
development  seriously.) 

I  would  like  to  consider  learning  and  the  learner  in  the  cogni- 
tive paradigm,  so  that  1  may  compare  these  concepts  as  they  appear 
in  the  post  structural  paradigm.    Learning  is  a  richer  concept 
within  the  cognitive  paradigm,  than  it  is  in  the  behavior la  para- 
digm.   Learners,  Wittrock  (1978)  indicates  are  actively  engaged  in 
constructing  or  generating  meaning  f  om  material.    The  explanation 
builds  on  the  behavioral  definition  of  learning.    When  a  learner 
interprets  any  stimulus,  he/she  constructs  meaning  based  upon  prior 
learning.    Comprehension  is  a  key  concept  here  and  proceeds  with 
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the  learner  attending  to  incoming  stiimili,  accessing  existing  know- 
ledge to  relate  to  it,  abstracting  new  knowledge  structures  and 
finally  encoding  those  into  memory.    (Rumelhart  and  Norman,  1978) 
This  learning  process  results,  in  some  cognitive  theories,  to  anmended 
knowledge  structures  which  then  may  be  accessed  to  interpret  new 
information.    This  is  a  truly  active  event  for  the  leaner,  not 
just  a  response  to  a  stimulus.    Meaning  or  understanding  is  generated 
by  the  learner  not  controlled  by  the  technology  or  its  designer. 
(It  is  a  while  since  we  have  heard  the  words  meaning  or  understanding, 
since  they  had  no  place  in  the  behaviorH  paradigm.    Yet  they  are 
old  concepts  within  gestalt  learning  theory  and  meaning  is  a  central 
concept,  as  I  have  noted,  in  the  structuralist  paradigm.  Meaning 
in  the  cognitive  and  structuralist  paradigms  differs). 
Hie  shift  to  a  focus  on  the  learner  and  knowledge  structures 
within  *he  cognitive  paradigm  has  vast  inplications  for  instruction- 
al designers  working  within  that  paradigm.    Designers  will  need 
to  become  less  hardware  oriented  and  less  systems  dependent  or 
dependent  on  new  systems  which  they  should  constiuct.    They  need  to 
he  "more  concerned  with  how  the  viewer  learns  from  media.    They  need 
to  be  concerned  with  facilitating,  not  controlling  learning". 
(Jonassen,  1984)    They  will  need  to  focus  on  learning  to  learn  and 
it  is  this  which  should  inform  any  new  designs  systems  which  emerge 
in  the  cognitive  paradigm.    As  Winn  (1981)  so  notes,  they  will 
need  to  focus  on  learning  strategies,  and  expand  mental  effort  to 
,    increase  th?  learner's  repertoire  of  mental  skills. 
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It  might  be  helpful  to  conpare  the  view  of  the  learner  in 
the  cognitive  paradigm  with  that  of  the  learner/viewer  in  the 
structural  paradigm.    Within  cognitive  theories  the  learner  is 
said  to  apply  learning  strategies  to  the  material  to  be  learned. 
He/sne  may  use  procedures  to  acquire,  retain  and  retrieve  dif- 
ferent kinds  of  knowledge  and  performance  (Rigney,  1978).  The 
procedures  or  competencies  might  include  information  processing 
strategies,  such  as  organizational  skills;  active  study 
strategies,  such  as  note  taking  or  outlining;  support  strategies, 
such  as  time  structuring  or  relaxation  techniques;  and  metacogrii- 
tive  strategies  in  which  learners  become  aware  of  and  monitor 
their  i earning.    (Weinstein  and  Underwood,  1983). 

Post  Structural  Reader  Theories 

Learning  is  never  spoken  of  as  such  within  the  structural 
paradigm  and  learners  are  never  mentioned.    Readers  are  mentioned, 
as  are  viewers,  but  the  concern  for  the  viewers1  creation  of 
::seaning  is  common  to  the  two  paradigms.    As  mentioned  above, 
structuralism  is  concerned  with  the  production  and  the  perception 
of  meaning  and  meaning  is  that  which  one  intends  to  convey  by 
a  human  act,  especially  language.    Inmediately,  one  can  see  that 
this  paradigm  is  concerned  with  media  consnunication  as  a  social 
act. 

Social  issues  were  crucial  research  issues  within  the  area  of 
educational  teclinology  before  World  War  II.    The  area,  in  fact, 
was  called  the  audiovisual  area  and  the  organizational  name  pre- 
ceeding  AECT  was  DAVJ ,  the  Division  of  Audio  Visual  Instruction. 
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Before  1940  artists,  Jtollywood  filmakers,  librarians,  educators, 
educational  administrators,  mass  communication  workers  and  govern- 
ment rqjresentatives  constituted  the \member ship  of  DAVI .  Varied 
professionals  kept  the  interests  in  this  field  broad,  but  the 
broad  perspective  was  lost  after  WWII  in  the  age  of  specialization. 
Within  the  new  instructional  technology,  participants  gained  rigor 
in  research  and  design  methods,  but  lost  an  interest  in  social 
issues.    Areas  of  film  and  TV  studies  and  mass  communication  in 
general  did  not  lose  this  interest  and  as  we  developed  rigorous 
experimental  methods  for  instructional  media  inquiry,  they  developed 
rigor  in  research  of  social  .issues  in  mass  media.    I  have  always 
thought  it  strange  that  instructional  technology  should  consider 
sbcial  issues  the  domain  of  mass  communications.    It  was  as  if 
educational  media  were  associated  only  with  learning  and  brain 
functions.    Yet, one  may  ask  if  the  presentation  of  three  cultures 
in  a  new  national  social  studies  Videotape  series  called,  "Across 
Cultures,"  is  such,  that  student  viewers  may  appreciate  and  vaule 
each  culture.    Our  normal  questions  would  have  centered  around 
the  issue  of  how  well  can  a  student  learn  from  this  series?  The 
series,  however,  prejudices  the  learner  in  favor  of  the  wealthier 
culture  and  tends  to  denigrate  the  poverty  stricken  culture. 
Evaluators  measuring  student  recall  of  factual  information  would 
not  uncover  this  fact.    Yet, we  bypass  the  responsibility  of  in- 
vestigating social  issues  in  educational  technology,  because  it 
does  not  fall  within  our  research  paradigm.    And  why  should  it 
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be  left  to  the  sociologists  to  study  the  social  interaction  of 
children  in  a  classroom  in  which  a  videodisc  system  is  present? 
Are  we  not  the  ones  who  will  design  much  of  the  educational  videodisc 
programs?   It  is  these  types  of  questions  within  our  field  that* 
call  for  a  paradigm  based  on  social  communication  such  as  the 
structural  or  post  structural  paradigm.    This  paradigm  would 
accomodate  such  questions  such  as,  "How  does  a  teacher  decode 
computer  advertisements?"   Designers  and  producers  of  software 
should  be  interested  in  that  issue.    Questions  of  how  educational 
messages  are  coded  and  decoded  in  any  medium  are  of  interest  to 
us  all. 

Structural  analysis  in  film  and  television  studies  and  mass 
media  have  offered  us  guidelines  for  the  consideration  of  social 
issues  in  educational  technology.    Within  this  analysis  the  re- 
lationship between  the  observer  and  the  observed  becomes  primary 
and  meaning  resides  in  the  relationships  which  people  construct 
then  perceive. 

Semiotocs,  which  is  a  system  for  the  study  of  sign  and  symbols 
within  any  communication  system,  offers  us  a  theory  within  the 
structural  paradigm.    Methods  of^ observing  and  decoding  may  be 
drawn-  from  the  social  sciences,  if  one  is  to  apply  semiotic  theory. 

V 

Helplul  semiotic  studies  and  observational  methods  are  summarized 
in  another  paper  (Becker,  1983)  and  are  mentioned  here  as  a  base 
for  research  which  followed.    It  is  that  research,  post  structural 
study,  that  is  of  interest  Were. 


ERIC 


88 
62 


10 
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As  mentioned  above, post  structural  researchers  building  on 

* 

structural  concepts,  have  included  the  viewer,  not  just  the  text 
or  the  medium,  in  their  structural  equation.    Some  of  these  hew 
theories  may  be  called  reader  theories  and  are  used,  not  just  in 
literature,  but  in  film  and  television  studies.    The  difference 
with  these  reader  theories  and  what  preceeded  them  is  the  emphasis 
on  the  viewer  and  his/her  construction  of  meaning.  Heretofore, 
meaning  within  semiotic  study  was  -  encoded  in  the  te:  t.  Now, 
meaning  does  not  become  meaning  until  the  reader  or  viewer  decodes 
what  has  been  encoded  in  the  text  or  film  or  TV  presentation. 
This  is  the  development  that  brings  ^jost^structuralism  closer  to 
cognitive  theory.    Post  structurally,  meaning  can  only  be  under- 
stood as  what  the  individual  intends.    It  is,  therefore,  the  in- 
dividual's intentions  which  produces  the  specific  relations  of 

differences  or  similarities,  within  the  structural  unit. 

How  wo j Id  the  learner  be  perceived  in  post/structural  studies? 
Essentially  he/she  would  be  understood  as  the  subject  (Coward 
and  Ellis,  1977)  of  the  meaning,  since  he/she  creates  meaning  from 
the  text  or  media  presentation.    How  does  that  understanding  dif- 
fer from  the  learner  in  the  cognitive  paradigm?   The  difference 
resides  in  the  fact  that  oost  structural  study  deals,  as  mentioned 
above,  with  social  knowledge,  so  the  learner  or  viewer  is  constructed 
as  a  social  person  belonging  to  a  group,  not  as  an  individual  person 
whose  brain  is  a  unit.    Investigation  of  how  social  groups  such  as, 
first  graders,  female  math  students  or  first  time  compiler  users 
construct  knowledge" would  be  conducted.   Analysis  of  how  the  text 
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or  media  presentation  is  encoded  is  ignored,  but  becomes  secondary 
to  the  questions  of  decoding  by  a  specific  social  group.  (Culler, 
1982)    In  fact,  messages  may  be  so  encoded  in  the  presentation 
that  space  for  certain  viewers,  such  as  female  math  students  or 
first  tine  computer  users,  is  excluded.   Yet,  these  exclusions 

may  not  be  obvious  to  the, designer.    It  is  the  viewer  who  has  to 

/ 

tell  us.    Psychoanalytic  theory  (Lacan,  L977)  can  be  used  to 
help  us  understand  the  viewer  and  his/her  social  knowledge. 

This  portion  of  the  inquiry  into  the  relationship  between 
cognitive  theories  and  reader  theories  has  attempted  to  describe 
notions  of  meaning  and  the  learner  within  tjjb  two  paradigms.  It 
has  described  some  of  the  assumptions  underlying  both  these 
theories,  and  suggested  implications  for  handling  social  and 
psychological  research  issues  in  educational  technology.  The 
next  section  will  describe  those  successful  reader  theory  studies 
which  could  be  used  as  guidelines  for  educational  technology 
research. 
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Research  Problem 

Prior  to  explaining  the  research  problem  addressed  by  this  study,  two 
questions  should  be  considered*    The  first  question  that  should  be 
considered  is,  ,fWhat  is  encoding  specificity  anyway?".    The  second 
correlative  question  is,  "Why  is  encoding  specificity  of  significance  to 
the  field  of  educational  technology  and  its  related  interest  areas?" 

Considering  the  first  question,  encoding  specificity  is  a 
psychological  construct  that  involves  the  interaction  between  the  encoding 
phase  of  memory,  or  the  learning  context,  and  the  stored  memory  trace,  and 
retrieval  cues  present  at  the  time  of  jesting  for  learned  information.  In 
other  words,  retrieval  of  a  memory  trade  at  the  time  of  testing,  can  be  a 
direct  function  of  the  match  between  cues  given  during  learning,  and  cues 
provided  during  testing.    The  more  isomorphic  learning  context  cues  are 
with  testing  context  cues,  the  mdfee  likely  the  probability  of  successful 
memory  performance.    Of  course,  given  a  miss-match  between  these  elements, 
the  inverse  will  occur.    The  major  issue  here  is  that  memory  of  learned 
information  is  not  simply  a  function  of  cognitive  or  mental  factors  alone, 
but  is  actually  influenced  by  cues  given  at  the  time  of  learning  and  cues 
given  at  the  time  of  testing.    Considering  the  logical  progression  of  the 
encoding  specificity  theory,  it  is  possible  then  to  have  information 
learned  or  stored  in  memory,  but  with  testing  cues  too  abstract  in  relation 
to  learning  context  cues,  test  performance  becomes  a  function  of  the  type 
of  cue  provided,  not  what  was  actually  learned.    In  other  words,  the 
learner  has  learned  the  information,  or  mastered  certain  objectives,  but 
performance  fails  as  a  function  of  the  test  not  what  material  has  been 
mastered  by  the  learner. 

The  answer  to  the  second^q^estion  may  at  this  time  be  obvious. 
Encoding  specificity  is  an  important  construct  for  educational  technology, 
since  our  primary  objective  is  the  design  of  effective  learning 
environments,  and  the  ability  to  evaluate  the  relative  success  of  learning 
specific  objectives.    The  encoding  specificity  construct  adds  an  additional 
consideration  to  the  design  of  learning  environments  that  is  the  concern 
for  the  match  between  learning. context  cues,  the  stored  memory  trace,  and 
testing  context  cues.    Care  should  be  taken,  however,  to  not  consider  the 
encoding  specificity  construct  as  simplistic,  or  common  sense.     The  counter 
argument  to  this  notion  is  the  large  number  of  studies  done  investigating 
encoding  specificity  and^its  complrx  effects  upon  memory  (Tulving,  1979; 
Thomson  and  Tulving,  1970).    An  additional  argument  favoring  encoding 
specificity  research  as  an  important  research  topic  for  educational 
technology,  is  the  vast  number  of  classroom  tests  that  present  mostly 
verbal  information  while  related  instruction  may  be  visually  oriented. 

Now  that  the  encoding  specificity  construct  has  been  defined  and  its 
importance  defended,  why  have  the  authors  decided  to  further  investigate 
encoding  specificity  since  so  much  seems  to  be  known  about  it  already  from 
psychological  research.    The  primary  problem  in  much  of  the  psychological 
research  on  encoding  specificity  is  the  incongruence  between  psychological 
experimental  designs  and  real  learning  environments  typically  found  in 
schools  and  training  situations.    The  traditional  encoding  specificity 
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study  uses  *  pai red- associate  learning  paradigm,  processes  subjects  an  an 
individual  bases ,  and  uses  very  simplistic  learning  tasks  (i.e.,  stimulus- 
response  learning).    For  example,  the  study  by  Tulving  and  Osier  (1968) 
used  the  following  experimental  design.    The  two  encoding,  or  learning, 
conditions  were:  XI)  target  words  plus  cue  Type  A,  and  (2)  same  target 
words  plus  cue  type  B,  these  form9  the  paired-associate.    The  two  retrieval 
conditions  were:  (1)  present  retrieval  cue  type  A,  get  response,  and  (2) 
present  retrieval  cue  type  B,  get  response.    The  Tulving  and  Osier  (1968) 
experiment  resulted  in  the  following  percentages  of  correct  recall. 
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While  their  results  clearly  showed  that  even  though  both  learning  context 
groups  received  and  learned  the  same  target  words,  successful  performance 
was  a  function  of  test  cue  type,  not  what  was  originally  learned.  J 

i    The  problem  with  this  type  of  experimental  design,  which  represents  1 
the  typical  encoding  specificity  study,  is  that  it  is  far  removed  fr6m 
classroom  instruction  which  typically  is  group  learning,  with  academic 
content,  and  group  testing.    The  primary  problem  addressed  by  the  present 
study  is  the  highly  clinical  nature  of  past  encoding  specificity  research. 
The  present  study  was  designed  to  evaluate  the  effects  of  encoding 
specificity  when  learners  were  in  a  typical  classroom  group  learning 
environment,  receiving  an  audiovisual  presentation  on  an  academic  subject, 
and  in  a  group  testing  environment.    However,  it  was  important  that  the  , 
basic  encoding  specificity  design  of  'target  to-be-learned  information1  and 
'varying  cue  type'  remain  constant  in  the  present  study.    In  other  words, 
the  basic  integrity  of  the  encoding  specificity  design  was  not  changed.  To 
accomplish  this  the  three  learning  conditions  in  the  present  study, 
pretsented  the  same  to-be-learned  target  information,  but  in  different 
learning  contexts,  each  having  different  contextual  cues.    However,  the 
to-be-learned  target  information  was  identical  in  each  of  the  three 
learning  conditions.     Similarly,  there  were  three  testing  conditions %  each 
condition  presenting  a  different  set  of  cues  corresponding  to  the  learning 
context  cues.     So  the  basic  encoding  specificity  design  is  apparent  in  the 
present  study  but,  students  received  their  instruction  in  a  classroom  group 
setting,  seeing  a  slide-tape  presentation,  the  instructional  content 
information  was  a  typical  type  of  academic  content  material,  and  testing 
was  done  in  a  classroom  group  setting. 
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Experimental  Design 

-  The  present  study  repre  rents  the  third  in  a  series  of  studies  done  by 
the  authors  on  the  variable  of  encoding  specificity,  and  its  effect  upon 
learning-memory- testing.    The  first  two  studies  yielded  significant 
results,  partially  supporting  the  encoding  specificity  hypothesis  and 
revealing  the  significant  relationship  between  the  learning  context,  stored 
memory  information,  and  the  testing  context  (Caneloe,  Taylor,  Altschuld, 
1983;  -"Canelos,  Taylor  Dwyer,  1984).    However,  this  study  is  an  attempt  to 
refine  the  pilot  study  (Canelos,  et  al.,  1983)  and  follow-up  study 
(Canelos,  et  al.,  jl984)  by  adding  an  instructional  treatment  and  refining 
the  testing,  or  cueing  conditions.    These  refinements  should  yield  results 
that  are  more  genei^alizable  to  the  classroom  instructional  situation. 
Additionally,  these  refinements  should  result  in  the  cross-over  statistical 
interactions  found  in  psychological  experiments  investigating  the  encoding 
spec'  icity  variable,  but  within  the  domain  of  a  classroom  learning 
environment  (see  hypothesis  of  interaction,  Figure  5).    During  the 
AECT-1984  KTD  presentation  of  the  follov-up    tudy  the  discussant,  Dr. 
Lar/oerski,  recommended  further  experimentation  with  our  research  design  on 
encoding  specificity.    Dr.  Lamberski  also  suggested  that  educational 
technology  researcher*  should  follow  through  with  their  research  by 
conducting  a  series  of  experiments  on  a  given  variable  to  refine  and  make 
more  applicable  their  concl  _.ons. 

The  original  pilot  study  partially  supported  the  encoding  specificity 
hypothesis,  which  states  that:     retrieval  is  facilitated  if  external 
retrieval  cues,  given  during  testing,  match  a  part  of  what  is  stored  in 
memory,  as  a  function  of  the  original  learning  context.     While  some  e 
researchers  may  claim  such  a  hypothesis  is  common  sense,  in  the  real  wor?d 
of  classroom  testing,  there  is  often  little  attempt  to  match  instructional 
context  cues  to  cues  given  on  the  test.    Most  classroom  tests  are  verbal, 
but  if  visuals  were  a  significant  part  of  the  instructional/learning 
context  (i  e.,  medical  and  engineering  instruction)  recall  will  be 
debilitated.     In  this  case,  the  learner  may  have  learned  the  correct  fact 
or  concept,  bu:  given  only  verbal  cues  on  the  test,  cannot  effectively 
respond.     The  original  pilot  study  used  the  following  experimental  design. 


ERIC 


96 

91 


4 


Free  Recall 


I 


Visually-Cued 
Becall  Test 


Verbally-Cued 
Recall  Test 


Immediate 
Test 


I  Visualized  I 
|  Instruction! 
I  P'  Audio  ! 
IP       am  ! 


|  Verbalized  1 
|  Instruction! 
I  Plus  Audio  I 
1  Program  1 


I  Visualized  I 
|  Instruction! 
I  Plus  Audio  | 
Seven-Day  1  Program  1 
Delay      |  Verbalized  I 
Test       I  Instruction! 

j  Plus  A^aio  | 
 1  Program  1 


Figure  1-     Original  Pilot  Study  Design 

The  pilot  resulted  in  the  following  disordinal  interaction  finding  partial 
support  for  the  encoding  specificity  hypothesis. 
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Figure  2:     Original  Resulting  Interactions 

However,  further  analysis  revealed  that  the  strong  results  on  the 
verbal-cue  test  occurred  because  the  test  was  operating  as  a  recognition 
test,  rather  than  a  cued  recall  test-     Recognition  tasks  tend  to  be  easier 
than  free  recall  and  cued  recall  tasks. 
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In  the  second  study,  the  verbally-cued  recall  test  was  changed  to 
function  as  a  cued-recall  measure.    To  evaluate  this  change  the  second 
study  was  conducted  using  the  following  experimental  design. 
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Figure  3:     Fol low-Up  Study  Design 

This  design  yielded  the  following  change  in  the  results,  and  again  found 
partial  support  for  the  encoding  specificity  hypothesis,  as  indicated  by 
disordinal  interaction  in  Figure  4. 
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Figure  4:     Follow-Up  Study  Interactions 

As  can  be  seen,  the  verbally-cued  test  is  operating  more  like  a  cued  recall 
test  than  a  recognition  test.    However,  the  encoding  specificity  hypothesis 
would  have  predicted  a  cross-over  interaction,  finding  that  subjects 
receiving  visualized  instruction  would  do  well  with  visual  cues  during 
recall  but  not  verbal  cues,  resulting  in  the  following  hypothetical 
interaction. 
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Figure  5:    Hypothesized  Resulting  Cross-Over  Interactions 

This  did  not  occur  in  the  follow-up  study  because  the  visualized 
instruction  group's  slide-tape  instructional  program  contained  a  visual 
slide  with  a  word  label  indicating  the  part  name.  This  label  must  have 
been  stored  in  memory  along  with  the  visual  context  on  the  slide,  since 
visualized  instruction  group  performed  equally  well  with  the  visually  c 
recall  and  verbally  cued  recall  tests. 

The  hypothesized  interaction,  presented  in  Figure  5,  represents  t 
general  hypothesis  for°  the  present  study,  which  used  the  experimental 
design  in  Figure  6. 
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Figure  6:     Present  Study's  Experimental  Design 

The  instructional  programs  were  an  adaptation  of  the  Dwyer  (1967) 
human  heart  instructional  and  testing  materials.     The  instructional 
materials  were  adapted  to  fit  the  design  of  an  encoding  specificity  study 
however,  this  adaptation  did  not  change  the  validity  of  the  Dwyer  materials 
as  a  logical  audiovisual  instructional  program  about  the. parts  and 
operation  of  the  human  heart.    The  Dwyer  instructional  materials  about  the 
human  heart  consist  of  an  instructional  presentation  designed  to  teach  the 
names  of  the  parts  of  the  heart,  heart  part  locations,  and  the  part 
functions  during  the  blood  flow  process  taking  place  as  the  heart  operates. 
The  Dwyer  instructional  program  on  the  human  heart  has  been  adapted  to  a 
variety  of  experimental  studies,  ranging  from  programmed  learning,  print 
materials,  and  computer  based  learning.    The  present  study  uses  the 
instructional  media  of  a  slide-tape  audiovisual  classroom  presentation  of 
the  basic  Dwyer  heart  instructional  program. 

The  experimental  design  is  a  2x3x3  Lindquist  type-II  design.  There 
are  two  between  subjects  variables  and  one  within  subjects  variable.  The 
within  subjects  variable  was  time  of  testing.    The  two  levels  of  the  within 
subjects  variable  are  immediate  testing  and  seven  day  delayed  testing. 

The  first  between  subjects  variable  was  type  of  instructional  program. 
Each  instructional  program  was  a  slide  tape  program  about  the  parts  and 
operation  of  the  heart.    Each  of  the  three  instructional  programs  provided 
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the  same  to-be- liar  tied  target  information,  which  was  the  names,  of  the  parts 
of  the  hearty  and  the  heart  phase  names.    This  information  was  provided  in 
the  audio  portion  of  the  slide  tape  program,  which  was  from  the  original 
Dwyer  heart  audio  script.    All  three  instructional  programs  used  the  same 
audio  program  tape,  having  the  same  heart  part/phase  description,  and  same 
pacing  hy  a  synchronised  pulse.    The  difference  in  the  three  instructional 
programs  was  the  type  of  cue  provided  by  the  slide  portion  of  the 
audiovisual  program. 

The  first  level  of  the  instructional  program  variable  vas  the  visual 
onlyfslide  set  plus  the  audio  program.    The  audio  program  was  22  minutes  in 
length  and  described  the  parts  of  the  heart,  the  part  names  and  locations 
in  detail,  and  the  heart's  operation.    The  first  level  of  the  instructional 
program  variable  slide  set  contained  37  color  visual  illustrations  of  the 
heart.    Each  of  the  slides  contained  an  arrow,  or  arrows,  pointing  to  the 
part  being  described  by  the  audio  program,  or  the  phase  or  operation  being 
described.    The  visual  only  slide  set  provided  only  visual  cues  on  each 
slide. 

The  second  level  of  the  instructional  progrcm  variable  was  the  visual 
with  verbal  label  slide  set.    This  instructional  program  used  the  same 
audio  program  tape  but  the  cues  given  were  quite  different  than  level  one. 
The  same  37  color  visual  illustration  slides  were  used,  as  in  level  one, 
but  the  slides  contained  a  verbal  label  describing  the  part  name, 
operation,  or  phase,  being  explained  on  the  audio  program. 

The  thiru  level  of  the  instructional  program  variable  was  the  verbal 
only  slide  set.    The  same  audio  progrim  tape  was  used,  but  again  the  cues 
^provided  in  the  learning  context  were  quite  different  than  the  level  one 
and  two  instructional  programs.    The  verbal  only  instructional  program 
contained  37  slides,  each  slide  presented  a  heart  part  name,  or  names,  or 
phase  names,  as  being  described  by  the  audio  program.    There  was  no  visual 
information  provided  on  the  slides  for  level  th*-*>e,  but  the  verbal  labels 
were  the  same  as  those  given  in  level  two.    So    '  Ae,  each  of  the  three 
levels  of  the  instructional  program  variable  provided  learners  with  the 
to-be-learned  target  information,  heart  part  names/phase  names,  this 
information  was  provided  with  different  cues  given  in  the  learning  context. 
Therefore,  while  ail  three  groups  received  the  same  to-be-learned  target 
information,  it  is  likely  that  they  processed  this  information  in  different 
ways,  contingent  'upon  cues  given  in  the  learning  context* 

The  second  between  subjects  variable  was  the  type  of  cue  provided 
during  testing.    The  first  level  of  the  test  cue  tr^riabl*  W*?  the  free 
recall  test.    As  the  name  implies,  in  the  free  recall  condition  the 
subjects  had  to  write  down  the  names  of  the  heart  part*  and  phase  names 
from  memory.    The  second  level  of  the  test  cue  variable  was  the 
visually-cued  recall  test.    Subjects  in  this  group  saw  a  set  of  color 
illustration  slides  of  the  heart.    Each  slide  contained  an  arrow,  or 
arrows,  pointing  to  a  heart  part,  or  describing  a  heart  phase.    The  subject 
had  to  write  down  the  correct  name  of  the  part  or  phase  that  the  arrow  in 
the  visual  illustration  slide  pointed  to.    The  third  level  of  the  test  cue 
variable  was  the^ verbally-cued  recall  test.    Subjects  in  this  group  saw  a 
set  of  slides,  with  each  slide  containing  a  three  letter  cue  of  a  heart 
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part  name  or  phase  name.    The  three  letter  cue  consisted  of  the  first  three 
letters  of  a  heart  part  name.    For  example y  for  the  heart  part  name 
Myocardium,  the  letters  Myo  would  be  given  on  the  slide.    Each  of  the 
testing  conditions  tested  for  the  same  objective  —  the  attainment  or 
memory  of  the  heart  part  names  or  phase  names.    But  each  testing  condition 
provided  different  external  cues. 

• 

Subjects  for  the  study  were  81  freshmen  from  Ohio  State  University. 
Subjects  received  course  credit  in  their  beginning  level  psychology  course 
for  participation.    Subjects  signed  up  for  the  study,  and  names  on  the 
sign-up  sheet  were  randomly  distributed  to  each  of  the  three  levels  of  the 
instructional  program  variable.    Each  level  of  the  instructional  program 
variable  was  conducted  during  one  day,  but  at  different  times. 

Each  of  the  instructional  program  level  groups  were  given  the  same 
amount  of  time  to  interact  with  the  heart  instructional  programs.  After 
their  program  ended  they  were  randomly  distributed  to  testing  condition. 
The  three  tests  were  conducted  by  the  experimenters.    Each  test  type  group 
was  given  a  maximum  ambunt  of  time  to  respond.    This  was  defined  as  the 
time  needed  for  all  persons  to  complete  writing  on  their  response  sheets. 
Upon  completion!  subjects  were  given  instructions  to  return  in  one  week  for 
the  delayed  testing  variable. 

Results  and  Conclusions 

Data  analysis  has  been  conducted  on  the  resulting  data,  using  the 
results  of  the  immediate  testing  level.    The  delr,  "*d  testing-data  has  since 
been  collected,  and  will  be  analyzed  and  presented  in  a  future  research 
article  by  the  authors.    The  resulting  analysis  of  variance  data  is 
presented  in  Table  1,  Part  1.    Resulting  means  and  standard  deviations  are 
^presented  in  Table  1,  Part  2. 

Table  1,  Part  1 
Resulting  Analysis  of  Variance  Data 
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Table  1,  fcart  2 
Resulting  Means  and  Standard  Deviations 
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The  resulting  significant  interaction  between  the  instructional 
program  variable  and  test  cue  variable  If , (2,72df )-3.507 ,p<.01 ]  finds 
support  for  the  encoding  specificity  hypothesis  in  this  study.  The 
significant  interaction  is  graphically,  displayed  in  Figure  7. 
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Figure  7:    Significant  Interaction  Instruction  x  Test  Cue. 

As  can  be  seen  in  Figure  7,  and  from  the  resulting  pattern  of 
simple  effect  means  in  Table  1,  Part  2,  test  cue  type  and  learning 
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context  cues,  had  a  significant  effect  upon  the  ability  to  perform  at 
the  time  of  testing.    In  all  three  instructional  conditions ,  the 
subjects  received  the  same  to-be- learned  target  information,  in  this 
case  heart  part  names  and  phase  names,  but  in  different  learning 
contexts*    Each  of  the  instructional  programs  provided  different  cues 
at  the  time  of  processing  to-be-learned  information.    If  a  miss-match 
existed  between*  type  of  cue  provided  during  learning,  and  type  of  cue 
provided  during  testing,  performance  on  the  instructional  objective 
debilitated,  even  though  subjects  f&d  stored  in  memory  the 
to-be-learned  heart  part  names  and  phase  names. 

These  results  indicate  that  test  performance  can  be 
significantly  effected,  either  positively  or  negatively,  by  the  type 
of  cues  given  at  the  time  of  testing.    In  this  case,  if  the 
inappropriate  cue  is  given  on  the  test,  performance  is  not  so  much  a 
matter  of  what  the  individual  has  learned,  but  more  a  result  of  the 
miss-match  between  learning  context  cues— the  stored  memory 
trace — and  testing  context  cues.    Therefore,  while  learning  may  have 
occurred  in  most  learners,  in  a  behavioral  sense,  inappropriate  test 
cues  will  result  in  their  demonstrated  performance  being  a  function 
of  test  cue  type  rather  than  acquired  intellectual  skills. 

Preliminary  data  analysis  and  results  have  indicated  that  the 
refined  experimental  design  has  resulted  in  the  typical  cross-over 
interaction  found  in  traditional  encoding  specificity  studies  in  the 
psychological  area  (Figures  6  and  7).    More  importantly,  these 
results  were  achieved  using  a  classroom  group  learning  situation,  in 
which  academic  type  content  was  presented,  and  testing  took  place  in 
a  classroom  setting.    These  preliminary  results  indicate  that  cues 
provided  in  the  instructional  setting  should  be  isomorphic  to  cues 
provided  during  testing.    If  visuals  make  up  an  important  part  of 
instruction,  similar  visual  cues  should  be  provided  on  the  test. 
Similarly,  if  instruction  is  essentially  verbal,  spatia1  tasks  on  the 
test  may  be  inappropriate.    While  this  basic  principle  seems  like  a 
simple  rule  to  follow,  it  is  amazing  that  with  all  of  our 
sophisticated  methods  of  visualising  content  testing  still  remains, 
for  the  most  part,  verbally  oriented. 
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^Abstract 


In  the  present  study,  the  effects  of  judgmental  and 
non-  j  udgpaent  a  1  CAI  on  the  self-esteem  and  mathematics  Achievement  of 


remedial  junior-high  students  were  examined.    Saoh  of  44  students  was 
given  a  self-esteem  pretest*    The  subjects  completed  a  basic 
mathematics  facts  drili  and  practice  CAX  program  with  varying  degrees 
of  judgmental  feedback,  and  rare  posttested  -on  the  self-esteem  scale. 
Although  no  statistically  significant  differences  were  found  among 
the  treatment  groups,  this  result  wis  more  likely  due  to  the 
shortftern  nature  of  the  study,  rather  than  an  absence  of  a 
relationship  between  judgmental  feedback  and  learner  self-esteem. 
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Examining  the  Effects  of  Varied  Computer-Based 
Reinforcement  on  Self -Esteem  and  Achievement : 
An  Exploratory  Study 

There  is  considerable  evidence  to  suggest  that  computer-assisted ' 
instruction  <CAf)  is  a  highly  effective  node  of  delivery  for 
instruction  (Kulik  ,1983).    Several  authors  have  shown  that  CAI  is 
especially  effective  for' self-motivated;,  high-achieving  learners 
(Hoffman  &  Waters,  1932*  Gershman  fi  Sakamoto,  1981 i  Menis,  Snyder,  & 
Ben-Kohav,  1.980).    However,  recent  attempts  to  utilise  computers  with 
migrant  and  minority  students  have  also  been  s-jcessftxl  (Crandall, 
J 976;  Saracho,  1982)    In  addition,  other  studies  have' shown  that  CAI 

4 

can  produce  achievement  gains  when  used  with  low  achievers  in  basic 
skills  areas  (Suppes,  1981).    Specifically,  CAI  drill  and  practice  v 

m 

programs,  used  as  "electronic  flashcards"  with  these  students  has 
been  effective  (Charp,  1981 i  Edwards ,  Norton,  Taylor,  Weiss  & 
Dussefldorp,  1975). 

In  a  recent  study  on  the  effects  of  CAI  on  student  attitude,  the 
authors  concluded  that  the  children  who  participated  in  CAI  programs 
believed  the  non-judgmental  nature  and  the  infinite  patience  of  the  . 
computer  made  learning  more  pleasant  than  coentional* instructional 
strateaitfs,  such  as  teacher-directed  practice  and  discussion  (Lawton 
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f  Gerechn*r,  1982).  The  positive  attitudes  of  these  students  were 
attributed   to  the  fact  that  the  computer  provided  consistent 

ck,  never  showed  signs  of  anger  or  frustration,  and  left  the 
ts  with  a  general  feeling  of  having  learned  "better"  (Clement, 
1981).  Other  authors  have  also  found  that  students'  attitudes  towards 

CAI  are  generally  positive  (Caffarella,  Cavert,  Legura,  Shtogren,  & 

\ 

wager,  1980;  Duby  6  Gil trow,  1978;  Garraway,  1 974}  Smith,  1973). 
However,  the  effects  of  CAI  on  broader  affective  traits ,  such  as 
self-esteem  has  not  been  established. 

Cv    f  the  key  benefits  of  CAI,  however*  nay  be  the  control  of 
reinforcement,  appropriate  to  the  characteristics  of  the  individual 
learner,  and  the  corresponding  lack  of  teacher  criticism*    During  the 
past  decade,  the  educational  community  has  concentrated  much 
attention  on  the  effectiveness  of  conventional  teacher  praise  as  a 
reinf orcer •  Several  researchers  have  shown  that  praise    can  be  an 
effective  reinf orcer    used  consistently  and  appropriately  (Heller  & 
White,  1975;  Lips  &  Jung,  1971 1  Meyer,  Bachmann,  Biermann, 
Hempelmann,  Ploger,  &  Spiller,  1979)*    However,  Brcphy  (1981)  noted 
that  praise  is  rarely  used  in  a  systematic  way  to  reinforce,  desired 
behavior*    Several  studies  have  supported  Brophy's  contention  that 
teacher  praise  can  often  have  deliterious  effects  on  student 
performance*    Such  praise  is  inconsistently  provided,  and  s  tdents 
tend  to  feel  demeaned  when  they  are  praised  for  correct  responses  on 
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tasks  they  view  ss  simplistic  or  trivial  (Bates,  1979;  Meyer ,  et  al. , 
1979i  Silberman,  1969). 

The  effects  of  jud Rental  kinds  of  leamer-coraputer  interaction 
on  the  performance  of  low-achieving  students  requires  further  study. 
In  addition,  although  much  is  known  about  the  effects  of  t&acher 
praise  as  a  rein forcer  in    conventional  classroom  settings,  little 
research  has  been  done  on  the  effects  of  positive  and  negative 
reinforcement  in  CAI,  where  the  interaction  can  be  controlled  more  or 
less  absolutely*    In  this  study,  the  effects  of  various  types  of 
reinforcements  on  both  learner  achievement  and  the  self-esteem  of 
low-achieving  students  were  studied. 

Methods 

Subjects 

The  subjects  of  this  study  were  44  eighth  grade  mathematics 
students,  drawn  from  three  remedial  mathematics  courses.  Placement  in 
these  courses  was  based  on  teacher  recommendations  and  standardized 
test  score  results.  The  average  Comprehensive  Test  of  Basic  Skills 
mathematics  score  for  students  in  this  study  was  the  39th  percentile. 
The  ethnic  composition  of  the  study  group  was  primarily  Anglo,  with  a 
minority  of  Hispanic  and  Black  students. 
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Materials 

Four  CAI  treatments  were  employed-    The  basic  CAI  program 
consisted  of  three  sets  of  10  randomly  generated,  multiplication  fact 
drill  and  practice  problems,    with  factors  ranging  from  one  to  nine. 
After  a  brief,  personalised  introduction ,  the  computer  alerted  the 
student  to  prepare  for  an  upcoming  problem  and  then  "flashed"  the 
problem  across  the  screen  in  low-resolution  graphics  for 
approximately  one  second*    The  students  were  then  shown  the  entire 
problem  in  regular  computer  text  for  approximately  three  seconds* 
If  or  example,  a  typical  problem  might  be:  "8  X  8  ■  ?"    The  computer  _ 
then  prompted  the  student  with,  "The  answer  is  ?"    At  this  point,  the 
student    entered  the  answer  and  the  computer  displayed  the  correct 
anew  for  approximately  5  seconds*    The  students  were  the  told  to 
prepare  for  the  next  problem,  whereupon  the  computer  repeated  the 
above  procedure*    The  program  was  entirely  computer-paced,  displaying 
the  problems  and  prompts  at  pre-defined  rates,  which  the  learner  was 
unable  to  charge*    The  program  was  modified  to  include  four  levels  of 
systematic  feedback* 


Affirmation  of  response  only.    For  the  purposes  of  this  study, 
affirmation  of  response  refers  to  notifying  the  learner  of  the 
correct  response,  without  any  feedback  as  to  the  nature  (correct  or 
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incorrect)  of  the  learner's  response. 

Affirmation  plus  positive  reinforcement  for  correct  response* 
Students  were  notified  of  the  correct  answer  and  systematically 
praised  by  the  computer  for  giving  the  correct  response*    In  this 
program,  the  rositive  reinforcement  nsisted  of  the  computer 

t 

displaying  a  happy  face,  ringing  a  bell  and  displaying  the  word 
"right*    in  bold  green  print*    No  feedback  was  provided  to  the 
learner  when  the  incorrect  response  was  given* 

Affirmation  with  negative  reinforcement  for  incorrect  response* 
Learners  were  provided  with  the  correct  response  and  systematic 
negative  reinforcement  when  the  incorrect  answer  was  given*  Negative 
reinforcement  consisted  of  the  computer  displaying  a  frowning  face, 
sounding  a  buzzer  and  displaying  the  word  "wrong91  in  bold,  red  print* 
No  feedback  was  provided  to  the  learner  when  the  correct  response  was 
given* 

Affirmation  plus  positive  and  negative  reinforcement*  This 
feedback  version  was  a  combination  of  the  latter  two  treatments. 

Depeant  Measures 

In  addition  to  the  four  levels  of  CAI  treatments  described,  the 
students  were  assessed  on  their  achievement  and  their  self-esteem* 

Achievement  measure*    The  number  of  correct  responses  provided 
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by  the  learner  for  each  of  the  three  sets  of  10  problems  of  the  CAI 
program  was  recorded  on  magnetic  disk*    Validity  of  the  CAI 
performance  measure  was  established  through  expert  review  and 
comparison  with  print-based  tests  of  multiplication  fact  mastery . 

Self -esteem  questionnaire*    Prior  to  the  CAI  treatment,  a 
pencil-and-paper  Likert-type  self-esteem  questionnaire ,  developed  by 
the  author,  was  administered  to  the  students     This  scale  consisted 
of  three  parts.  The  first  of  the  three  parts  contained  12  items  and 
focused  on  the  students9  mathematics-related  self-esteem*  For 
example ,  the  student  was  asked  to  rate  stateman  such  as  "I  try  hard 
in  math"  on  a  five-point  scale,  ranging  from  "all  of  the  time"  to 
"not  at  all."    The  second  part  of  the  scale  contained  16  items  and 
concerned  general  self-esteem  questions  such  as  "I  get  along  well  at 
home"*  and  "I  am  popular."    The  third  part  of  the  questionnaire 
contained  8  items  addressed  the  students*  self-esteem  relative  to 
using  the  computer  itself*    Typical  questions  from  this  section  were 
"I  am  smart  enough  to  learn  about  cosgmters"  and  "I  am  not  afraid 
about  working  with  coe^uters."    Each  section  of  the  scale  utilised 
the  same  type  of  response  format*    The  reliability  of  the  self-esteem 
questionnaire  was  0*87,  using  test-retest  data  obtained  prior  to  the 
study.    Validity  of  this  measure  was  also  established  through 
coultation  with  experts  in  the  field. 
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Procedure 


After  the  subjects  were  pretested  for  initial  levels  of 


self-esteesi  using  the  self-esteem  questionnaire,  they  were  designat  id 
as  relatively  high  or  low  in  achievement  and  randomly  assigned  to  one 
of  the  four  treatment  groups*    The  students  then  completed  three  sets 
of  10  problems.    3c ores  from  each  of  the  sets  were  recorded.  After 
completion  of  the  CAI  treatment,  the  subjects  were  postested  for 
self-esteem  using  the  same  scale* 

Experimental  Design  and  Data  Analysis 

Hiis  experiment  employed  a  completely  crossed,  4x2  factoral 
design,  f eat uritS  four  levels  of  feedback  (affirmation  of  response, 
affirmation  with  positive  reinforcement ,  affirmation  with  negative 
reinforcement,  and  affirmation  with  positive  and  negative 
reinforcement)  and  two  levels  of  achievement,  high  and  low  (based  on 
CTBS  scores )•    Dependent  measures  included  three  measures  of  poet test 
self-esteem  (general  self-esteem*  computer  self-esteem,  and 
mathematics  self-esteem)  and  one  measure  of  performance  from  each  of 
three  trials  with  a  basic  skills  mathematics  program* 

osttest  self-esteem  scores  were  analysed  with  MAHCOVA 
procedures,  with  pre-test  self-esteem  as  the  covariate*  Achievement 
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differences  were  also  analyzed  with  MANOVA  procedures  for  repeated 
measures  designs. 


The  means  for  the  individual  pretest  self-esteem  measures  are 

contained  in  Table  1  and  the  means  for  the  individual  posttest 
self -esteem  measures  are  contained  in  Table  2.    The  affirmation  of 
response  with  negative  reinforcement  treatment  consistently  obtained 
the  highest  reported  levels  of  self-esteem  across  each  scale. 
However,  although  there  is  a  general  trend  of  improvement  in 
computer-related  self-esteem  across  all  treatment  groups*  the 
differences  among  the  treatment  means  within  each  scale  were  not 
statistically  significant.    In  addition,  there  were  no  significant 
differences  between  high  and  lew  achievers. 

The  mean  percentage  of  correct  responses  made  during  each  of  the 
three  trials  of  the  CAI  program  are  contained  in  Table  2.  The 
performance  across  treatments  was  uniformly  high  on  all  trials, 
averaging  over  90  percent  accuracy  for  both  high  and  low  levels  of 
prior  achievement.    No  significant  dif fences  among  the  means  were 
found  for  either  CAI  treatment  or  prior  achievement  level. 


Results 
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INSERT  TABLES  1,  2,  AND  3  ABOUT  HERE. 


Discussion 

T.*a  purpose  of  this  study  was  to  examine  the  relationship 
between  the  judgmental  nature  of  CAI  feedback  used  and  the  resulting 
achievement  and  self-esteem  of  learners*    While  no  significant 
differences  were  found,  several  important  points  warrant  discussion • 

The  tentative  hypothesis  that  non- judgmental ,  or  neutral, 
feedback  in  CAI  would  produce  the  most  favorable  attitudes,  and 
correspondingly,  the  highest  levels  of  learner  self-esteem  was  not 
supported  by  this  study.    This  belief  evolved  from  research  in 
conventional  instruction,  which  indicates  that  neutral  feedback,  as 
opposed  to  positive  or  negative  reinforcement,  produces  the  highest 
levels  of  achievement  and  motivation,  when  the  learning  task  is 
simplistic  in  nature  (Bates,  1979;  Brophy,  1981*  Meyer,  et.  al. , 
1979i  Silberman,  1969).    Although  not  supported  in  the  present  study  # 
this  lack  of  support  may  be  due  to  the  short-term  nature  of  the 
study,  ratr  than  an  absence  of  the  relationship  itself* 
Self-esteem  is  the  product  of  many  factors,  including  environmental 
factors  such  as  family  and  friendships ,  and  personal  characteristics 
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•uch  as  attitude.    An  individual's  level  of  self-esteem  is  determined 
through  years  of  development*    The  participants  in  this  study  were 
subjected  to  the  experimental  program  for  only  two  instructional 
periods f  for  a  total  of  approximately  90  minutes,  with  the  actual 
treatment  varying  in  time  between  10  and  30  minutes.    It  is  unlikely 
that  any  short-term  change  in  instructional  strategy,  even  those 
utilising  the  bias-free  capabilities  of  the  computer ,  could  produce 
noticeable  changes  in  accumulated  levels  of  self-esteem.    The  results 
of  this  study  reinforce  the  strength  of  self-esteem  as  an  evolved 
trait,  in  that  no  significant  changes  could  be  fostered  through 
relatively  short  interventions. 

while  no  differences  were  produced  in  the  brief  time- frame  used 
in  this  study  it  is  possible  that  longer  term  interventions  might 
prove  effective.  One  might  expect  that  high  levels  of  self-esteem,  as 
well  as  low  levels  of  self-esteeraare  cultivated  through  proper 
learning  experiences  and  manipulations  of  the  individual's 
environment.    If  so,  then  perhaps  self -esteem  can  be  improved  through 
the  long-term  use  of  planned  positive,  and  controlled  learning 
experiences.    Computer-based  instruction  offers  a  potentially 
powerful  tool  in  controlling  the  nature  of  the  learner-instruction 
interaction,  and  perhaps  the  resulting  self-esteem* 

The  underlying  assumption  of  this  study  is  that  CAI,  by  its 
nature,  is  only  as  judgmental  as  the  designer  dictates*  Computers 
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can  be  programed  to  be  non- judgmental  in  their  assessments  of 
learner  performance,  aince  ^unli ka^t eapher s ,    they  poaeeae  no 
inherent  emotions.    Computers  are  only  capable  of  diaplaying  emotion 
that  the  programmer  deema  appropriate*    Feedback  that  is  demeaning, 
or  subject  to  mi  a  interpretation  on  the  part  of  the  student,  can  be 
avoided.    Gocsputers  can  be  programmed  to  be  completely  consistent  in 
their  use  of  whatever  reinforcement  ie  necessary .    Hence,  CAI  should 
be  an  ideal  instructional  delivery  system  icertain  types  of 
feedback  and  interactions  are  found  to  be  destructive  to  the 
a elf -esteem  of  the  individual  learner* 

Other  factor  a  may  have  hankered  the  present  attempt  to  detect 
reliable,  meaningful  effects.    There  was  an  apparent  "ceiling"  effect 
on  the  self -esteem  measures  ,  leaving  little  room  for  improvement  on 
the  poetteat.    Xn  addition,  the  CAI  task,  multiplication  fact  drill 
and  practice,  may  have  contributed  to  the  ceiling  effect,  due  to  the 
simplicity  of  the  task.    Since  subjects  di  j  very  well  cm  the  drill 
and  practice  program,  averaging  over  90  percent  in  each  of  the  four 
treatment a,  it  seems  probable  that  the  negative  reinforcement 
feat  urea  of  the  treatments  were  rarely  seen.    The  lack  of  negative 
reinforcement  might  .well  have  contributed  to  the  ceiling  effects  by 
causing  the  students  to  perceive  the  computer  as  a  pleasant  way  to 
learn. 

Some  important  general  trends  were  detected  in  this  study.  For 
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example,  on  the  average,  computer  self-esteem  scores  iag>roved 
somewhat  for  all  the  treatment  groups,  indicating  that  thair 
attitudes  towards  CAI  improved  somewhat  as  a  consequsnce  of  thair 
exposure  to  the  program  (aaa  Tables  1  and  2).    In  addition,  students 
in  the  "affirmation  of  response  only"  and  "affirmation  plus  negative 
reinforcement*  treatments  performed  slightly  better  than  the  other 
treatments*    When  the  absence  of  negative  reinforcement  caused  by  the 
ceiling  effects  is  considered,  this  result  is  consistent  with  the 
r-otion  that  "affirmation  of  response"  alone  yields  the  highest  levels 
of  both  achievement  and  self-esteem* 

Because  of  the  important  pedagogical  effecte  of  learner 
self-esteem  and  the  emergence  of  CAI  as  an  important  instructional 
delivery  system,  further  study  is  warranted.    The  learning  task  used 
in  the  CAI  program  should  be  expanded  to  include  both  drill  and 
practice  and  a  tutorial  segment  that  provide  the  basic  instruction  in 
a  new  skill  or  skills*    This  expansion  would  eliminate  problems 
caused  by  the  students  being  too  faliar  with  the  subject  matter* 
Next,  the  self-esteem  measures  should  be  expanded  in  order  to  detect 
more  subtle  changes  in  learner  self-esteem,  by  adding  more  items* 
eliminating  item-overlap,  and  possibly  adding  a  teacher  observation 
portion  to  the  scale.    Finally,  the  time  frame  of  the  study  itself 
should  be  lengthened,  in  order  to  examine  longitudinal  effecte  of  CAI 
on  learner  self-esteem* 
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xhe  purpose  of  this  study  wis  to  determine  if  student  self-esteem 
end  achievement  could  be  effected  through  the  use  of  reinforcement  in 
CAX.    Although  statistically  significant  differences  aaong  treatment 
groups  were  not  found,  eonfe  general  trends  were  detected  that  should 
be  explored  with  future  research .    Further  research  will  help  to 
establish  the  feasibility  of  the  computer  in  providing  reinforcement 
that  will  systematically  improve  learner  attitudes,  confidence,  and 
overall  self-esteem. 
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Thble  1«   Cfcnaral,  iufttlMUtttic9  nd  ujnaAai  pretest  aelf^etogn  s&sns  fear  high"*  lobr^chievexs 


IVpe  off  Fteftack 


Affirmation  of 

Affirmttlnn  w/ 

• 

Affiliation  w/ 

Affirmation  w/ 

Tatal 

Bemxnm  Only 

ftjeittwe  R 

Nscvtive  R 

Itos*  6  Neg.  R 

High 

26.67 

26*56 

25.67 

28.29 

27.10 

(n-3) 

(n-5) 

(n-3) 

<w»7) 

(n»18) 

Low 

25.33 

26.20 

26.67 

27.43 

26.39 

(n«6) 

(w-9) 

(n-3) 

(n-7) 

(rr2 

Tbtal 

26.22 

26.43 

26.17 

27.86 

26.69 

(n-9) 

(n-W 

(n-6) 

tn-14) 

0*43) 

Msdisns^icB  Se^^^^^£eo& 

29.33 

28.56 

30.00 

30.00 

29.49 

Low 

27.33 

27.20 

29.57 

25.00 

2U90 

Total 

28.00 

28.07 

29.79 

27.50 

28.10 

CXiUJutai  S&lf-Bstsen 

31.33 

27.00 

27.00 

24.29 

26.67 

Lew 

29.67 

22.20 

26.71 

27.43 

26.60 

Total 

30.78 

25.29 

26*86 

25*86 

26.28 

Tbtal  Self-ateem 

Hi# 

87.33 

82.12 

82.67 

82.58 

83.26 

Low 

82.33 

75.60 

32.95 

79.86 

80.09 

Total 

85.00 

79»79 

82.82 

81.22 

• 

81.07 

Note:   All  cell  aiaes  ate  identical  to  those  listed  tnder  General  Self-EBteem. 
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TSahle  2*  (¥mti1  #  MtJuBtici  and  oaqautar  posLtcst  Mlf  osteon  mans  far  hicjh-  and  Icti^&chifiUBzs 


Typo  of  Fteodfeoric 


Af fixnaticfi  of 

Affirmation  w/ 

AffdzsBtion  w/ 

AffixoBticn  W 

fetal 

Lewi 

Response  Ctoly 

Bositine  R 

Nsjst  ive  R 

Its.  &  Meg.  R 

Gnsral  SdaSfistem 

Hie* 

28.67 

29.40 

31.67 

28.14 

29.17 

(n-3) 

(hf5) 

(w»3) 

(df7) 

(n-18) 

low 

26.00 

27.78 

28.00 

28.71 

27.64 

(tf6) 

(hf3) 

(»-7) 

(n-25) 

26*89 

28.36 

29.83 

28.43 

28.28 

in*) 

(n-14) 

(rrt) 

(n-14) 

(n-d3) 

MftUwuBtioB  9sl£Hi*vL0UU 

Hicfi 

32.67 

31.80 

33.67 

29.14 

31.22 

lau 

28.67 

29.11 

33.67 

31.43 

30.20 

Tbtal 

30.00 

30.07 

33.67 

30.29 

30.63 

Qccgutei  SelfHEtetesn 

Hicfi 

33.67 

30.20 

25.33 

30.43 

X.06 

Low 

30.50 

28.56 

33.00 

25.86 

28.80 

Total 

31.56 

29.14 

29.17 

28.14 

29.33 

1*^*1  Self— BgtfiCDt 

95.00 

91.40 

90.67 

87.71 

90.44 

Low 

85.17 

85.44 

94.67 

86.00 

66*64 

Ttotal 

88.44 

87.57 

92.67 

86*86 

8B.23 

Hbtes  All  cell  sizes  am  identical  to  those  listed  iwfer  General  aelf-fistaaa. 
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Tfchla  3.  Ad 

lieveaent  aeans  fear  hi*-  and  low^echievezs 

Leted  instruction. 

IVpe  of  lesdback 

Affirmation  y/ 

affirmation  W 

Affi  rentier  W 

Total 

Level 

Response  Oily 

Boaitive  X 

Negative  R 

Foe.  &  Reg.  R 

Tidal  Che 

High 

96.67 

91.11 

93.33 

92.86 

93.09 

(art) 

(n-6) 

(nK3) 

(n»7) 

(n-18) 

Lav 

96.67 

86.00 

83.33 

82.86 

87.36 

(n-9) 

(nH3> 

(n-7) 

(n-flS) 

Dotal 

96.67 

87.82 

88.33 

87.86 

89.76 

<n-S> 

(n-W 

(n-6) 

(n-M) 

(n-43) 

T*ial  TWo 

High 

95.00 

94.44 

96.67 

88.57 

92.62 

Low 

90.00 

92.00 

96.67 

92.86 

92.32 

■total 

91.67 

92.87 

96.67 

90.72 

92.44 

Trial  Three 

Hi* 

96.67 

94.44 

100.0 

95.47 

96.13 

Law 

12.22 

92.87 

96.67 

93.57 

93.45 

Tbtal 

92.22 

92.87 

96.67 

93.57 

93.45 

Total  Achiewnant 

High 

96.11 

93.33 

96.67 

92.30 

93.95 

Lav 

92.22 

90.00 

91.11 

89.05 

90.40 

natal 

94.17 

91.67 

93.89 

90.68 

91.89 

Hotei   All  cell  sizes  are  identical  to  those  listed  under  Trial  cue. 
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The  Relationship  of  Film  Theory  to  Instructional  Television 
INTRODUCTION* 

Media  vidistics  scholar  Martin  Perlmutter  (1981)  has  noted 

in  an  essay  on  the  language  of  televisions 

It  is  easy  to  suppose  that  television  is  electric 
*  film.  It  is  also  probably  wrong/  and  certainly 

unscientific/  to  simply  assume  so  and  make  no  further 
inquiry  (p.  417). 

Whereas  most  informed  media  theorists  and  practitioners 

could  scarcely  argue  with  such  a  proclamation  in  light  of  current 

semiological  discourse  methodologies/  instructional  television 

production  practices,  partially  based  on  instructional  designs, 

may  not  acknowledging  this  distinction  (Clark  and  Salomon/  1984). 

As  a  media  consultant  at  the  University  of 

Wisconsin-Madison,  I  am  constantly  in  contact  with  instructional 

design  models  that  only  recognize  differences  between  film  and 

television  as  resultant  of  how  each  media  viscerally  accommodate 

learner  characteristics  and  task  requirements  (Romiszowski, 

1981).  These  distinctions  are  of  value  when  forging  designs 

because  they  keep  pedagogical  considerations  prominent.  However, 

at  the  level  of  presentation,  where  all  for|iats  and  forms  are 

engendered  by  culture,  and  historically  interpreted  by 

spectators,  the  differences  between  theseAwo  media  far  exceed 

simple  distinctions  of  learning  capabilities  and  task  analyses. 

Furthermore,  the  range  of  conditions  far  surpass  screen  size  and 

resolution,  or  the  ability  to  control  a  scan  function  button. 

These  conditions  include  a  cultural  context  for  the  production, 

distribution,  and  reception  of  film  and  television  presentational 

forms  (Ellis,  1982). 
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Since  there  is  a  disparity  in  the  appropriation  of 
terminology  between  the  fields  of  educational  media  and 
communication  arts  and  sciences#  the  terms  format  codes  and 
presentational  forms  will  be  briefly  outlined  here*  Format  codes 
are  culturally  and  historically  articulated  rules  and  sets  of 
indentifiable  elements  that  are  manifested  in  film  and  television 
program  types*  such  as  news,  sports ,  education,  drama,  variety, 
and  advertising  (Williams,  1974).  Presentational  form  refers  to 
the  manner  in  which  textual  information  is  organized  and 
represented.  Presentational  formr  have  specific  "types"  of 
articulations  within  the  text.  These  articulations  are  evidenced 
in  editing,  camera  angle,  and  any  number  of  other  presentational 
devices • 

The  main  problem  here  is  that  differences  in  the  format 

codes  and  presentational  forms  of  film  and  television  are 

recognized  by  media  producers  and  spectators i  yet,  not  by 

instructional  designers  (Reigeluth,  1923).  John  Ellis,  in  his 

book  Visible  Fictions  (1982)  argues  that  producers  and  spectators 

are  not  only  aware  of  media  differences,  but  that  the  production 

and  viewing  processes  of  television  are  acts  of  compliances 

Broadcast  TV  can  thus  be  seen  as  having  a  distinctive 
aesthetic,  different  from  cinema.  It  offers 
relatively  discrete  and  shot  segments  organised 
according  to  the  patterns  of  repetition  and 
innovation  offered  by  the  series  and  serial  form,  or 
merely  into  an  agglomeration  like  a  group  of 
advertisements.  These  series  forms  are  oriented 
towards  the  repetition  of  a  basic  dilemma  rather  than 
the  resolution  of  an  onward  narrative  movement. 
Often,  the  problematic  that  the  series  offers  is  that 
of  vision  itself t  news  and  current  affairs  anchor 
themselves  around  the  conception  of  the  programme 
format  as  an  eye  roving  across  the  world* s  events. 
The  viewer  tends  to  delegate  his  Or  her  own  look  to 
the  Institution  of  TV.  This  delegation  is  made 
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possible  by  the  immediacy  that  the  broadcast  image 
claims  for  itself,  despite  the  fact  that  almost  all 
broadcasts  are  prerecorded.  This  immediacy,  with  its 
major  form  of  direct  address,  and  its  dramas 
overwhelmingly  concerned  with  notions  of  the 
domestic,  can  creat  a  sense  of  complicity  between  the 
TV  viewer  and  institution.  Both  are  in  the  home*  the 
TV  functions  as  a  safe  means  of  scanning  the  world 
outside  (p.  170).  m 

Through  the  production  and  reception  of  format  codings,  the 

relationship  of  the*  viewer  to  the  institution  of  television 

perpetuates  the  legitimizing  function  of  the  medium  as  an 

ontologically  correct,  "meaning"  producing  agency.  Based  on  the 

complicity  of  production  and  reception,  presentational  forms  are 

utilized  to  perpetuate  or  reproduce  this  complicity  and  establish 

an  aesthetic  standard.  According  to  Ellis,  viewers  and  producers 

recognize  media  differences  because  they  are  aware  of  di spa rites 

in  the  appropriation  of  presentational  forms,  and  the  aesthetic 

standards  associated  with  these  forms,  that  represent  their  own 

relationship  to  the  agency  of  production* 

No  matter  how  prescriptive  the  pedagogical  coding  of 

instructional  television  production  processes,  instructional 

designs  generally  do  not  acknowledge  the  complex  presence  of 

non-pedagogical  codes,  such  as  those  borrowed  from  film,  and  how 

these  codes  might  control  and  influence  the  "reading"  of  these 

texts.  Whereas  an  instructional  designer  may  only  consider 

pedagogical  codes  on  which  to  base  presentational  forms  and  their 

production  specifications,  instructional  television  producers  are 

faced  with  a  universe  of  codings  infinitely  more  complex.  * 

The  aim  of  this  inquiry  is  not  to  change  current 

instructional  design  specifications  for  television  production/ 

but  rather,  to  suggest  how  they  may  be  extended  into  a  more 
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precise  domain  vhere  forms  of  presentation  may  be  cataloged  and 
culturally  Refined.  Differences  between  film  and  television  can 
be  identified  in  the  utilization  of  presentational  forms  and 
their  historical  and  cultural  modes  of  production,  distribution, 
.  and  reception.  Furthermore ,  ignoring  these  differences  can 
confound/  if  not  negate,  the  entire  design  process  by  neglecting 
a  possible  locus  of  control. 
BACKGROUND! 

At  last  year's  meeting  of  the  Society  for  Cinema  Studies, 
Steve  Lipkin  (1984),  in  his  presentation  on  how  film  and 
television  interface,  quite  rightfully  suggested  that  television 
analyses  might  be  far  better  informed  if  someone  were  to  cast  an 
inquiry  method  in  a  mold  similar  to  Noel  Burch's  Theory  of  Film 
Practice  (1981),  only  applied  to  television.  That  is,  a  taxonomic 
examination  of  presentational  forms  and  formats  located  in 
television  programs.  This  suggestion  is  not  completely  novel  in 
light  of  current  formalist  inquiries  into  television  aesthetics, 
such  as  those  forwarded  by  Herbert  Zettl  (1981).  Moreover, 
methodologies  for  television  analyses  formulated  in  Great  Britain 
by  members  of  the  Glasgow  University  group  (eg.  Stuart  Hall),  the 
Channel  Four  network,  and  media  scholars  such  as  John  Fiske 
(1978),  John  Hartley  (1978),  Raymond  Williams  (1974),  Albert  Hunt 
(1981),  Ann  Kaplan  (1983),  and  John  Ellis  (1982)  have  taken  up 
this  precise  task  of  applying  the  more  developed  concepts  of  film 
theory  to  the  analysis  of  instructional  television. 

In  a  recent  issue  of  Screen  (1984)  magazine,  television 
theorist,  John  Caughie,  situates  the  historical  development  of 
television  criticism  and  theory.  He  posits  that  Classic  film 
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theories/  such  as  those  created  by  Eisensteln  (1949),  Arnheim 
(195*7),  and  Kracauer  (1960),  generally  suffer  from  ontological 
essential isra  in  their  search  for  an  object  of  discourse.  In  the 
seventies,  film  theorists  such  as*  Metz  (1974)  and  Wollen  (1972) 
evoked  cultural  and  sociological  methodologies  to  mobilize 
semiology  beyond  this  formal  essentialism.  It  is  at  this  point  in 
history,  and  in  this  tradition,  that  television  theory  was 
developed  and  socio-cultural  methodologies  were  adopted.  However, 
Caughie  notes  that  as  the  result  of  the  different  developmental 

periods  in  which  film  and  television  theories  were  forged,  a 

(] 

disparity  emerged t  Namely,  an  object  of  discourse i 

Where  dissatisfaction  comes,  I  suppose,  is  finally  . 
with  television  theory's  failure  to  engage 
dialectlcally  with  the  film  theory  of  the  seventies. 
Rather  than  confronting  its  past  productively,  a  great 
deal  of  television  theory  and  criticism  seems  to  be 
trying  to  reject  the  unwanted  parent  at  the  same  time 
as  tying  itself  to  its  terminological  apron  strings. 
The  result  is  a  very  generalized,  and  sometimes  quite 
inappropriate  sense  of  discourses  of  television.  We  - 
still  don't  really  understand  the  very  basic  and 
specific  formal  operations  of  television  within  its 
programme  categories i  the  organisation  of  look, 
continuity  editing,  the  differences  between  mixing  and 
editing,  the  construction  of  space,  camera  movement, 
i      sound  and  image  (p.  119). 

In  othervords,  by  placing  television  in  a  socio-cultural 

framework  of  representation  before  examining  the  formal 

operations  of  the  medium,  television  theory  has  provided  little 

in  the  way  of  analyses  of  presentational  forms  or  other  objects 

« 

of  discourse.  This  paper  proposes  to  partially  rectify  this 
problem  by  utilizing  a  hybrid  media  analysis  technique  based  on 
Burch's  formalist  film  theory  and  Ellis  television  theory. 
METHODOLOGY I 

This  inquiry  proposes  to  facilitate  Burch's  formalist  film 
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theory  to  create  an  inductive  comparative  analysis  technique  by 
which  to  examine  the  utilization  of  presentational  forms  located 
in  instructional  television  texts.  Noting  the  curreVit  trend  of 

media  scholars  applying  film  theory  to  the  analyses  of 

« 

television,  this  inquiry  will  incorporate  the  television  theory 
of  John  Ellis  (1982)  to  contextualize  the  productron, 
distribution,  and  reception  of  these  presentational  forms  in. a 
cultural  framework.  In  otherwprds,  Burch's  film  theory,  which  . 
identifies  presentational  forms,  will  be  utilized  as  a  J:ool  for 
examining  instructional  television  texts,  while  Ellis'  television 

•j 

theory  will  be  employed  to  examine  Burch's  methodology.  This 
cross-referencing  of  film  and  television  theory  should  create  a 
checks-and-balances  system  for  analyzing  both  the  object  of 
discourse  and  its  cultural  context.  Finally,  it  will  be  suggested 
hov  the  information  generated  by  this  inquiry  technique  might  be 
facilitated  in  instructional  designs. 
INQUIRY  METHODS 

Noel  Burch,  the  founder  of  1'  Institut  de  Formation 
Cinema togrphique,  a  French  school  of  film  theory  and  production, 
is  generally  considered  by  media  scholars  to  be  a  formalist  , 
theorist  because  of  his  emphasis  on  presentational  form  and 
syntax  in  the  production  of  the  medium.  Burch  organizes  his 
analysis  technique  to  include  six  primary  classifications t  1). 
dialectical  parameters*  2 ) •  spatiotemporal  articulations ,  3 ) • 
screen  and  off -screen  space,  4).  plastic  interactions,  5). 
subject  matter*  and  6).  perturbing  factors .  These  six  elements 
operate  systematically* and  constitute  the  decoupaae*  or 
operational  structure  of  presentational  forms.  Burch  situates 
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filmic  form  as  dynamic?  systematically  complex. 

Burch  argues  that  there  are  foundation  structures  to  film. 
Furthermore ,  these  structures  are  always  posed  in  dialect ica1 
opposition  to  each  other/  and  apply  to  every  presentational  form* 
These  dialectical  parameters  include  legibility  and  duration. 
There  is  a  dialectical  relationshipNsetween  what  presentational 
forms  are  perceptible  or  impercep t ibl e  and  expanded  or 
contracted.  For  example,  the  longer  (duration)  a  presentational 
form  appears  on  the  screen,  the  easier  it  is  to  identify  it 
(legibility). 

Other  dialectics  include  photographic  parameters  such  as 
soft  or  sharp  focus,  black  or  white  shading,  and  monochrome  or 
color  film  stock. 

Burch  also  identifies  organic  dialectics  such  as  absence  or 
presence  of  >image,  intraf rame  movement  or  static  central  subject, 
backward  or  forward  motion  around  a  stationary  image,  fast  or- 
slow  motion  around  normal  velocity,  live  or  animated  subject 
matter,  exterior  or  interior  decor,  and  location  or  studio 
setting. 

Narrative  time  constitutes  yet  another  subcategory  of 

s 

dialectical  parameters  and  designates  presentational  forms  as 
past  or  present  tense,    temporally  framed  as  flashbacks  or 
f lashf orwards,  and  thematic  or  plastic  variations. 

Dialectical  parameters  also  include  the  structural  uses  of 
sound  as  demonstrated,  by  the  formal  presence  of  sound  or  silence, 
synchronous  or  asynchronous  sound,  and  live  or  dubbed  sound. 

According  to  Burch,  when  a  film  is  a  completed  unit  that 
has  achieved  decoupage,  presentational  forms  are  organized  in 
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successions  of  temporal  and  spatial  articulations .  Temporal 
articulation  refers  to  the  organization  of  shot  transitions. 
Spatial  articulations  refers  to  the  manner  in  which  the  space 
represented  by  two  shots  in  succession  maintain  or  distort  the 
continuity  of  the  film*  Burch  emphasizes  that  all  temporal 
articulations  must  be  accompanied  by  spatial  articulations  of 
form.  This  is  how  the  time/space  relationship  of  film  is 
represented.  The  convergence  of  spatial  and  temporal 
articulations  generate  patterns  of  mutual  inference.  Mutual 
inference  refers  to  the  set  of  of  controlled  spatial  ,and  temporal 
articulations  that  are  formally  presented  at  any  given  transition 
between  shots.  Burch  proposes  that  there  are  five  types  of 
temporal  articulations/  which  include  the  following*  1).  absolute 
temporal  continuity/  2 ) •  time  abridgement/  3 ) .  indefinite  time 
ellipsis/  4).  short  time  reversal /  and  5).  indefinite  time 
reversal .  Each  of  these  temporal  articulations  are  accompanied  by 
one  of  the  three  types  of  spatial  articulations i  1).  absolute 
spatial  continuity,  2 ) .  absence  of  spatial  continuity ,  and  3 ) . 
proximate  or  radical  discontinuity.  By  indexing  temporal  and 
spatial  articulations/  fifteen  patterns  ,of  mutual  inference  can 
be  identified. 

The  use  of  screen  and  off-screen  space  ^is  another  factor  to 
^b«  considered  when  identifying  presentational,  forms  in  the  filmic 
text.  Space  may  be  represented  on  the  surface  of  the  screen,  but 
also/  by  what  is  not  included  in  this  presentational  form. 
Off-screen  space  may  be  represented  in  film  via  directional 
vectors  created  by  movements  of  the  subject  matter  and  apparatus. 
For  example/  off-screen  space  may  be  represented  in  a  film  when  a 
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character  walks  out  of  the  frame  i  thus  indicating  to  the 
spectator  that  there  is  space  beyond  the  proscenium  of  the 
screen.  Off-screen  space  may  be  left,  right,  above ,  below,  and 
behind  area  projected  on  the  screen,  as  veil  as  the  space 
occupied  by  the  camera. 

Burch  suggests  that  the  editing  of  shots  in  sequence  not 
only  generates  spatial  and  temporal  articulations,  but  also 
Plastic  interactions  between  shots.  That  is,  the  surface  or 
material  of  the  film'  fragments  also  effect  the  presentation  of 
forms.  Plastic  interactions  do  not  account  for  cinematic  or 
narrative  time  and  space.  Rather,  plastic  interactions  account 

i 

for  the  real  time  and  space  in  which  film  fragments  are  joined 
together.  Burch  identifies  two  types  of  plastic  interactions: 
static  and  dynamic.  A  static  articulation  is  created  when  a 
match-cut  between  two  shots  portrays  the  linked  filmic  material 
as  inactive.  Conversely,  when  one  or  both  shots  utilize  the 
movements  of  fragments  of  film  in  the  plastic  process  of  editing, 
*the  articulation  is  dynamic. 

Burch  argues  that  much  of  film  theory  is  centered  around 
analyses  of  the  subject.  However,  tehcac  theorists  generally 
appropriate  the  subject  to  be  a  term  for  theme  or  plot.  Burch 
rejects  this  use  of  the  term  and  appropriates  it  in  two  different 
manners.  First,  the  subject  of  a  film  is  the  material  form  or 
essential  substance  of  discourse.  Secondly,  Burch  refers  to  the 
subject  as  a  generic  terra  that  describes  "what"  the  structure  of 
the  film  is  used  to  represent.  Therefore,  the  subject  is  both  the 
material  form  or  configuration  of  film  fragments,  and  the 
structure  that  these  fragments  represent ^ 
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Film  subjects  may  either  be  fictional  or  non-fictional . 
Fictional  subjects  are  those  that  employ  traditional  dramatic 
narratives  based  on  literary  conditions.  These  conditions  are 
used  to  evoke  experiences  that  are  interpreted  by  the  viewer  as 
being  caused  by  an  invariable  relationship  between  the  filmic 
discourse  and  "reality."  Non-fiction  film  is  possible  only 
through  the  utilization  of  cinematic  conditions  of  the  subject  to 
represent  an  abstract  "reality."  These  cinematic  conditions  are 
employed  to  evoke  experiences  that  are  interpreted  by  the  viewer 
as  being  caused  by  the  presentational  structure  of  the  filmic 
discourse. 

Burch  notes  that  the  formal  domain  of  film  can  be  altered 
by  the  presence  of  disruptive  or  perturbing  factors.  One  element 
out  of  the  filmic  phenomenon  out  of  place  can  render  the  entire 
continuity  of  presentational  forms  chaotic .  Two  perturbing 
factors  are  singled  out  by  Burch  to  examine  theiv  confounding 
role  in  the  production  process:  chance  and  structures  of 
aggression.  Chance  refers  to  those  disruptive  elements  that 
jeopardize  the  filmmaker's  ability  to  control  or  regulate  his 
production  practices.  Structures  of  aggression  are  those 
presentational  forms  that  violate  the  tacit  agreement  between  the 
screen  and  spectator  to  perpetuate  a  hypnotic  condition,  by 
producing,  through  discontinuity,  surprise  and.  discomfort. 

In  total,  Burch' s  film  theory  represents  a  systematic 
method  of  cataloging  presentational  forms  located  in  filmic  texts 
and  delineating  how  the  interrelationships  of  these  forms 
constitute  the  aesthetically  communicative  operations  of  this 
structure.  The  categorization  of  specific  presentational  forms 
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enables  the  theory  to  inductively  posit  a  generic  conception  of 
the  medium,  but  not  necessarily  the  only  conception. 

Utilizing  this  film  theory  to  examine  different  media  poses 
the  problem  of  comparing  dissimilar  objects.  Burch's  film  theory 
allows  for  a  general  media  analysis  technique  by  which  to  explore 
the  objects  of  discourse,  but  it  has  no  context  in  which  to  posit 
their  relevance  to  television.  In  order  to  make  Burch's  film 
theory  applicable  to  television,  it  must  be  situated  in  the 
context  of  television  theory  so  that  the  modus  operandi  of 
Burch's  own  inquiry  method  may  be  scrutinized  to  determine  if  the 
production,  distribution,  and  reception  of  presentational  forms 
are  operationally  similar  or  dissimilar  in  both  media. 

John  Ellis  (1982)  employs  methodologies  borrowed  from  film 
theory  to  address  the  relationship  between  the  economic 
institutions  that  produce  each  medium,  which  he  proposes 
influences  the  production  of  presentational  forms.  Ellis  suggests 
that  one  such  consequence  of  the  economics  of  production  is  the 
historical  mode  of  presentational  form  articulated  in  film  as 
opposed  to  the  live  mode  articulated  in  television.  Ellis 
contends  that  the  film  spectator,  via  their  cultural  placement 
and  consciousness  of  the  mode  in  which  films  are  produced  and 
distributed,  assumes  that  the  diegetic  events  depicted  in 
presentational  forms  have  already  occurred  before  the  point  of 
presentation.  That  is,  the  spectator  assumes  that  the  story  has 
already  occurred  and  that  the  medium  is  just  neutrally  recanting 
the  tale.  Television,  on  the  other  hand,  never  allows  its 
narrative  mode  to  come  to  a  point  of  closure  or  resolution 
because  of  its  utilization  of  serial  presentational  form,  which 
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is,  of  course ,  a  direct  reflection  of  <dts  economic  production  and 
distribution.  Sports  programs ,  soap  operas,  situation  comedies 
and  the  evening  news  all  perpetually  return  to  the  tv  screen 
hour-after-hour,  day-after-day,  and  week-after-week.  As  a  result 
of  seriatura  presentational  forms,  television  is  perceived  as 
being  continuous i  even  when  programs  are  taken  out  of  the  context 
of  this  flow  and  presented  in  a  classroom  situation  (Williams, 

1974).  The  viewing  pattern  of  television  is  established. by 

1 

thousands  of  hours  of  home  viewing i  not  one  discrete  classroom 
showing. 

In  addition,  for  Ellis,  the  relationship  of  the  sound  and 
image  of  television  to  narrative  form  is  also  resultant  of  the 
complex  relationships  between  media  producing  institutions  and 
viewers  t 

Broadcast  TV  characteristically  offers  an  image  that 
is  stripped  down,  with  no  unnecessary  details. 
Cutting  produces  forms  of  variation  of  visual 
information,  and  sound  has  an  important  role  in 
drawing  the  viewer's  attention  back  to  the  screen. 
The  image  and  sound  both  tend  to  create  a  sense  of 
immediacy,  which  process  a  kind  of  complicity 
between  the  viewer  and  the  TV  institution.  This  can 
provide  a  powerful  form  of  consensus,  since  it  tends 
to  define  the  domestic  place  of  the  TV  set  as  a  kind 
of  norm,  against  which  the  * outside  world* 
represented  on  TV  can  be  measured.  This  regime  of 
image  and  sound,  together  with  the  segment  and  series 
forms,  has  created  a  distinct  form  of  narration  in 
broadcast  TV  (p.  144). 

This  broadcast  TV  form  of  narration  proposes 
itself  to  a  particular  kind  of  viewer,  a  viewer 
relaxing  at  home.  It  makes  certain  assumption,  more 
or  less  unwar rented,  about  this  viewer,  and  proposes 
a  particular  kind  of  position  of  viewing  for  the 
viewer.  This  form  of  viewing  attitude  has  the  effect 
of  sealing  the  consensus  nature  of  broadcast  TV 
(p.  159). 

According  to  Ellis,  all  presentational  forms  in  television  are 
utilized  by  dominant  institutions  of  production  to  direct, 
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through  the  use  of  narrative,  the  communicative  or  meaning-making 
relationship  of  the  agency  of  the  medium  and  the  viewer i  thus, 
maintaining  perceptions  that  TV  is  a  consensus  form*  a 
■democratic  window"  to  the  world.  Therefore,  presentational  forms 
are  generated  to  provide  codings  that  perpetuate  social  and 
cultural  relationships.  In  otherwords,    Ellis'  television  theory 
is  inter textual i  it  is  used  to  examine  the  relationship  of  the 
text  to  its  cultural  and  social  context.  On  the  otherhand, 
Burch* s  film  theory  is  intra  textual  i  it  is  used  to  examine  the 
relationships  of  presentational  forms  that  are  operative  within 
the  text.  Ellis,  like  cultural  theorist  Terry  Lovell  (1980), 
situates  the  text  and  its  utilization  of  presentational  forms  as 
the  product  of  complicity.  In  contrast,  Burch  situates  the  text 
in  its  use  of  presentational  forms  as  the  result  of  aesthetic  and 
poetic  contradictions  implict  in  the  organization  of  form. 

In  practice,  Burch* s  categories  would  be  used  to  analyze 
specific  instructional  television  texts.  The  utilization  of 
presentational  forms  located  in  the  texts  would  then  be 
documented  and  categorized.  These  forms  would  then  be  examined  in 
light  of  their  context,  as  figured  by  Ellis'  television  theory. 
This  raatrice  of  Burch  and  Ellis  will  hopefully  allow  for  both 
intertextual  and  intra textual  analyses. 
TEST  APPLICATION t 

To  test  this  inquiry  technique,  I  chose  an  instructional 
television  program  entitled  "Supervisory  Skills  Assessment."  It 
was  designed  by  Dr.  Geraldine  Markel  (1983)  and  produced  by 
Instructional  Strategy  Services  at  the  university  of  Michigan-Ann 
Arbor • 
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It  should  bo  noted  here  that  in  light  of  time  restraints, 
this  test  inquiry  will  be  at  best  terse*  It  is  presented  here 
merely  to  give  you  an  idea  of  how  this  inquiry  technique 
operates . 

The  program  utilizes  a  vide  array  of  presentational  forms. 
They  are  summarized  as  follows i  dialectical  parameters  display  a 
definite  tendency  tovard  perceptibility ,  expansion,  sharp  focus , 
neither  black  or  white  shading,  color,  presence  of  image,  static 
central  subject,  forward  motion,  live  subject,  interior  decor, 
present  tense,  neither  flashback  or  flashforward,  thematic 
variations,  and  synchronous  sound,  both  live  and  dubbed. 

In  addition,  spatiotemporal  articulations  between  shots 
generally  employ  absolute  temporal  continuity,  with  a  few  time 
abridgements,  as  well  as  absolute  spatial  continuity  within 
scenes,  and  absence  of  spatial  continuity  between  scenes. 

On-screen  space  is  most  commonly  utilized  in  this  I TV 
program.  Off-screen  space  is  rarely  represented. 

Without  exception,  all  plastic  interactions  between  shots 
are  static  articulations . 

The  subject  matter  type  is  fictional  since  this  particular 
I TV  ^program  utilizes  presentational  forms  as  representations  of 
realty  and  not  the  medium  itself. 

Finally,  there  is  little  evidence  of  chance  or  structures  of 
aggression  in  this  program,  save  a  few  lens  refractions  and 
mid-day  shadows. 

Whereas  it  is  impossible  to  infer  from  one  test  analysis 
that  I TV  utilizes  presentational  forms  that  are  similar  or 
dissimilar  to  those  utilized  by  film,  as  posited  by  Burch,  there 
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are  some  distinct  patterns  here  that  might  be  addressed  by  Ellis' 
contextual  theory  of  television.  For  example,  this  program 
displays  a  definite  tendency  towards  the  zero  point  of  style. 
That  is,  the  utilization  of  codes  that  perpetuate  historical  and 
cultural  continuity  via  the  use  cf  presentational  forms.  These 
forms  maintain  a  perceived  transparent  relationship  between  the 
medium  and  reality.  The  program  does  not  employ  novel  codes  that 
might  implicate  its  structural  method  of  presentation.  In 
othervords,  this  I TV  program  sticks  to  modes  of  presentation 
historically  perpetuated  by  film,  and  later,  television.  If 
programmatic  inquiries  indicated  that  utilization  of  these  „ 
specific  forms  were  historically  perpetuated  by  instructional 
format  codings,  the  resultant  information  would  provide 
instructional  designers  vith  a  means  by  which  to  maintain  the 
status-quo  of  instruction  or  recast  its  trajectory  via  the 
manipulation  of  presentational  fcrms. 

Furthermore,  and  perhaps,  more  importantly,  although  there 
might  appear  to  be  a  large  overlap  in  the  utilization  of 
presentational  forms  by  both  film  and  television,  Burch's 
formalist  theory  appropriates  a  descriptive  method  of  inquiry 
that  provides  a  description  of  "what"  these  forms  arei  not  just  a 
pedagogical  prescription.  This  information  allows  the 
instructional  developer  to  utilize  each  medium  according  to  an 
entire  range  of  presentational  forms.  A  range,  in  its  complexity, 
recognized  by  viewers. 
CLOSING  COMMENTS I x 

The  cross-refierencing  of  Burch's  film  theory  and  Ellis' 
television  theory  represents  only  one  conception  of  a  critical 
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inquiry  technique  for  the  analysis  of  instructional  television. 
In  an  effort  to  expand  the  critical  base  of  this  inquiry 
technique,  other  formative  film  theories ,  such  as  those  posited 
by  Eisenstein  (1949)  and  Arnheim  (1957),  would  be 
cross-referenced  with  television  theories,  such  as  those  advanced 
by  Williams  (1974)  and  Fisfce  and  Hartley  (1978),  might  provide 
additional  information  about  the  relationship  between  the  two 
media. 

Program  formats,  such  as  news  and  sports,  would  then  be 
contrasted  for  similarities  and  dissimilarities.  In  short,  by 
cross-referencing  these  theories,  a  taxonomlc  conception  of  what 
forms  are  present  in  what  texts  under  what  conditions  can  begin 
to  be  formulated.  It  must  be  stressed  here,  that  this  type  of 
inquiry  is  only  the  first  step  in  a  series  of  inquiries.  As  John 
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Caughie  (1984)  has  pointed  out,  programmatic  research  on  how  film 
and  television  interface  will  become  increasingly  important  as 
both  media  are  incorporated  in  new  hybrid  program  forms,  such  as 
Home  Box  Office  TV,  and  hi-tech  movies,  since  these  hybrid 
programs  may  utilize  even  more  complex  presentational  forms. 

Burch' s  film  theory  was  forged  to  raise  the  consciousness 
of  filmmakers  in  regard  to  how  control  of  the  medium  may  be 
obtained  through  the  utilization  of  specific  presentational 
forms.  Curiously  enough,  control  and  regulation  are  also  salient 
concerns  of  instructional  design  models.  There  is  no  apparent 
reason  that  the  taxonomic  information  generated  by  this  inquiry 
method  could  not  be  directly  incorporated  into  production 
specifications,  partially  influenced  by  design  models,  for 
instructional  television.  The  utilization  of  pedagogical  codes 
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may  be  aided  or  confounded  by  the  utilization  of  television 
presentational  forms.  Therefore,  it  seems  logical  that  these 
presentational  forms  be  accounted  for  in  order  to  more  precisely 
regulate  control  of  the  medium,  and  thus,  its  ability  to  instruct. 
QUESTION  AND  ANSWER  PERIOD* 
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Research  Problem 


The  basic  principle  inherent  in  the  design  of  micro-computer  based 
instructional  programs  is  the  utilisation  of  a  self-paced  instructional 
method.    However,  there  are  sow  indications  that  moderate  levels  of 
external  and  guided  pacing  nay  be  more  effective  for  learning  in 
facilitating  student  performance* levte Is,  both  in  amount  of  content 
acquired,  and  instructional  objectives  levels  attained.    Thie  hypothesis 
was  tested  in  this  study  using  three  types  of  pacing,  and  evaluating 
learned  competency  on  five  achievement  tests  ranging  in  difficulty  from 
memorising  facts  to, solving  problems.    Experimental  results  supported  the 
hypothesis  favoring  moderate  levels  of  external  pacing,  and  concluded  that 
the  general  assumption  that  permitting  students  to  interact  in  a  totally 
self -paced  instructional  environment,  was  not  the  most  effective 
instructional  method  for  facilitating  student  achievement  for  all— types ~o£ — 

micro-computer  instruction* 

> 

Educational  Technology  and  Attempts  to  Address  Individual  Differences 

Researchers  froa  a  variety  of  different  disciplines  have  considered 
the  problea  of  learner  individual  differences  and  their  influence  on 
subsequent  learning.    A  promising  area  of  research  which  evolved  to  address 
individual  differences  of  a  cognitive  nature  was  Aptitude  Treatment 
Interaction  (ATI)  research.    The  general  premise  of  the  ATI  effort  was  to 
propose  fundamental  predictions  on  how  to  design  individual  * instructional' 
treatments  to  address  specific  aptitude  types  (Cronbach,  1 967^  Cronbach  and 
Snow,  1969).    The  ATI  and  Trait  by  Treatment  ln^eracti£a~resea?ch 
demonstrated  that  individual  differences  could  be  defined  along  the  lines 
of  a  cognitive  paradigm  such  as  that  proposed  by  Kagen,  Most  and  Sigei 
(1963).    Each  individual  difference  type  could  be  characterized  as  a 
certain  cognitive  style,  and  varied  instructional  treatments  might  then  be 
prepared  to  maximise  the  specific  information  processing  capabilities  of 
all  the  cognitive  styles  in  a  given  group  of  students,  in  a  given  school 
curriculum.    While  theoretically  valid,  it  does  not  take  a  great  deal  of 
effort  to  note  that  the  practical  aspects  of  such  an  instructional  system 
would  be  tenuous1  at  best.    Unfortunately,  the  construct  of  individual 
learning  differences  remains  a  problem  for  teachers,    whether  the 
individual  difference  variable  is  defined  as  genetic  intelligence,  as  a 
cognitive  style,  or  as  an  attitude,  these  individual  difference 
characteristics  have  significant  influences  upon  achieving  various 
instructional  objectives  in  the  context  of  an  academic  learning  environment. 
A  more  applied  method  of  attempting  to  isolate  and  attend  to  individual 
differences  has  been  through  the  design  of  instructional  systems  where 
learner  control  over  the  pace  of  instruction  was  permitted  to  vary  aa  an 
independent  variable.    The  value  of  self-paced  instruction  was. pointed  out 
by  Carroll  (1963)  in  his  treatise  defining  aptitude  as  time  required  to  . 
learn  to  competency  level.    This  treatise,  of  course,  became  the 
instructional  system  known  as  mastery  learning  (Block,  1971). 

A  number  of  other  instructional  systems  have  bjeen  designed  around  the 
idea  of  addressing  individual  differences  by"  employing  some  type  of  an 
instructional  system  based  upon  learner  control  via  self-paced  instruction 
(Cross,  1976).    The  early  research  on  programmed  learning  (Skinner,  1958) 
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was  based  on  the  empirical  benefits  df  errorless  learning,  immediate 
feedback,  and  self -pacing.    The  Personalised  System  of  Instruction  (PSI) 
developed  by  Keller  (1974),  and  the  individually  Prescribed  Instruction 
System  (IPI)  developed  by  Glaser  (1968)  both  have  as  their  basis  the 
benefits  of  self-pacing.    Similar  to  the  PSI  and  IPI  instructional  methods, 
Postletbwait vs  Audicr  Tutorial  System  (1974)  is  an  attempt  to  address 
individual  learning  difference  by  self-pacing.    Early  vork  in  the  area  of 
CAI  adopted  the  principles  of  programmed  learning,  and  therefore  attempted 
to  accommodate  for  individual  differences  by  self-pacing  (Atkinson, 
1968).    As  educational  technology  has  now  advanced  to.  the  utilisation  of 
micro-computer  based  instructional  strategies,  the  conclusion  regarding  the 
benefits  of  designing  micro-instructional  systems  to  be  self-paced,  as  a 
way  of  adjusting  for  individual  learning  differences,  has  been  geneially 
accepted  by  our  field.    However,  there  is  some  indication  that  external 
control  may  be  more  effective  than  learner  control  of  pacing,  in  terms  of 
learning  achievement.    For  example,  Cropper  (1964)  found  that  a  fixed-paced 
method  was  more  effective  than  self-paced  alone.    Similar  results  are 
reported  by  Reiser  (1984),  who  found  less  procrastination  in  completing  a 
learning  task  with  a  type  of  external  control  as  opposed  to  complete 
learner  control  of  progress  pacing. 

Arguments  favoring  moderate  levels  of  external  control  of 
instructional  program  pacing  can  be  found  in  Cognitive  Psychology  research, 
dealing  with  the  psychological  variables  of  attention  and  motivation.  In 
discussing  his  generative  learning  model  based  upon  current  findings  from 
cognitive  psychology,  Wittrock  (1978,  p. 9)  cites  *our  key  factors  directly 
effecting  learning:     "(1)  Semantic  and  abstractive  processes  in  memory, 
such  as  schemata,  rules,  and  algorithms;   (2)  distinctive  or  episodic 
memories,  such  as  images  or  verbal  memories;  (3)  attention,  and  (4)  4 
motivation."    Fro*  Wittrock9 s  position,  two  key  elements  directly  affecting 
learning,  at  a  cognitive  information  processing  level,  are  attention  and 
motivation.     It  is  likely  that  locus  of  control  over  instructional  program 
pacing  will  have  a  direct  effect  upon  attending  behavior  and  motivation,  at 
a  psychological  information  processing  level.     In  other  words,  if  moderate 
external  pacing  of  an  instructional  program  can  increase  client ion  and 
motivation  at  a  basic  psychological  level,  the  learner  should  acquire  more 
information  in  less  time  than  in  self-paced  instructional  programs.  The 
Zeigarnick  Effect  and  Ovsiankina  Effect  have  revealed  that  increased  levels 
of  psychological  motivation  on  problem  solving  tasks  tend  to  improve  memory 
and  transfer  beyond  the  original  learning  tasks  (DeCecco,  1963).  Similar 
effects  on  motivation  and  attending  behavior  are  found  with  the 
Yerkes-Doduon  Law  (Travers,  1972),  yielding  results  indicating  that 
moderate  levels  of  motivation  :  ^prove  memory  and  intellectual  skill 
performance.     It  is  likely  that  *.h*  self-paced  instructional  method  may  not 
be  the  most  appropriate  instructional  approach  for  all  possible 
applications  of  CAI  using  micro-computer  based  instruction*  if  attention 
and  motivation  are  considered.     Xn  a  recent  literature  review  on  the  topic 
of  learner  control  over  instruction,  Carrier  indicated  similar  conclusions 
regarding  amount  and  order  of  instruction  (Carrier,  1984,  p.  17): 

'*Many  CAI  designers  assume  that  by  exploiting  the  technical  capabilities  of 
the  computer,  they  can  increase  student  learning.    For  at  least  one  of 
these  technical  capabilities — allowing  students  to  exercise  their  own 
judgment  about  how  much  instruction  they  need  or  in  what  order — this 
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assumption  appears  to  be  premature.    There  is  little  support  from  the 
research  literature  that  offering  students  control  will  lead  to  increased 
learning  (p.  17). M 

The  present  study  was  conducted  to  test  the  experimental  hypothesis 
that  moderate  levels  of  external  pacing  of  a  micro-computer  instructional 
program  would  increase  motivation  and  attending  behavior  and  this  would 
result  in  the  more  effective  learning  of  instructional  content,  in  terms  of 
both  the  amount  learned  and  level  of  competency  performance  using  the 
learned  content*    A, second  hypothesis  tested  was  that  moderate  levels  of 
external  pacing  should  improve  the  overall  time  efficiency  of  learning  the 
instructional  content.    The  third  hypothesis  was  that  higher  achievers,  as 
defined  by  the  highest  test  scores  on  the  five  dependent  measures,  would 
opt  for  additional  instruction,  in  the  form  of  elaborate  feedback,  more 
than  lower  achievers  on  the  five  dependent  measures.    The  third  hypothesis 
would  indicate  that  lower  achieving  students  may  not  be  in  a  position  to 
opt  for  more  instruction,  but  may  require  being  forced  into  an  elaborate 
feedback  loop  after  a  series  of  errors. 

Experimental  Design  and  Procedures 

To  test  the  first  experimental  hypothesis,  a  4x5  Lindquist  Type-I 
analysis  of  variance  was  used,  having  four  between  subjects  levels  and  five 
within  subjects  levels.    The  between  subjects  factor  was      type  of  external 
pacing  of  the  micro-computer  instructional  program,  and  its  four  levels 
were: 

1.  Self-paced  program  (SP). 

2.  Externally-paced  program,  normal  reading  speed,  plus 
Cognitive  processing  time  (£P+Cp) 

3.  Externally-paced  program,  normal  reading  speed,  no 
Cognitive  progressing  time  (EP-Cp). 

4.  Control.  ' 

The  within  subjects  factor  represented  different  levels  of  instructional 
objectives,  defined  as  learning  tasks.    There  were  five  levels  of  learning 
task,  and  they  were  called: 

It     List  learning  task 

2.  Spatial  learning  task.  Cued-recall 

3.  Simple  Concept  learning  task 

4.  Complex  Concept  learning  task 

5.  Spatial  learning  problem,  free  recall 

The  second  hypothesis  was  tested  by  collecting  time  data  on  overall 
time  to  complete  the  instructional  programs  by  each  subject  and  averaging 
across  subjects.    This  data  will  be  presented  descriptively.    The  third 
hypothesis  was  tested  by  collecting  the  number  of  options  for  feedback  on 
each  subject  working  through  the  instructional  programs.    The  top  six  test 
scores,  in  each  pacing  condition,  were  then  defined  as  higher  test 
achievers,  and  the  low  six  test  scorers  in  each  pacing  condition,  were 
defined  as  lower  test  achievers.    An  analysis  of  variance  was  conducted 
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between  the  high  achievers  opts  for  feedback  and  the  low  achievers  opts  for 
feedback,  at  each  level  of  instructional  program  pacing. 

Each  of  the  three  micro-computer  instructional  programs  was  designed 
to  teach  subjects  about  the  parts  and  operation  of  the  human  heart  during 
systolic  and  diastolic  functioning.    The  instructional  content  was  an 
adaptation  of  the  original  Dwyer  (1967)  stimulus  materials.  The 
instructional  content  in  each  of  the  three  instructional  programs  and 
sequence  of  content  was  identical.    Each  instructional  program  contained  57 
instructional  segments  which  consisted  of  one  or  tiro  frames  (individual 
computer  displays)  of  instruction  describing  the  heart  parts  and  heart 
functions.    Each  frame  of  inatruction  consisted  of  a  visual  with  a  verbal 
description  and  arrow,  or  arrows f  pointing  out  the  important  information  in 
that  display.    There  were  three  types  of  visuals  used  in  the  instructional 
programs  (Figure  1).    Each  instructional  display  consisted  of  some 
combination  of  one  of  the  visuals  and  a  verbal  explanation  (Figure  1). 
Each  of  the  three  micro-computer  instructional  programs  making  up  the 
external  pacing  factor  will  be  described  in  detail.    The  graphics  and  text 
were  authored  using  Apple  Super PILOT.    Verbal  instruction  was  presented  in 
each  program,  at  a  normal  reading  speed,  (300  words/min. )  although  two 
programs  are  externally  paced  at  the  point  of  instruction  and  elaborate 
feedback. 

(1)  Self  Paced  Instructional  Program 
The  SP  instructional  program  is  self-paced  at  the  poitf  of  instruction 

and  feedback.    Each  of  the  57  instructional  segments  start  with  the  heart 
drawing,  then  part  or  phase  names  appear,  then  an  arrow,  or  arrows, 
followed  by  the  instructional  text.    After  each  completed  instructional 
display  ife  generated,  the  learner  has  as  much  time  as  desired  to  study  the 
instructional  display.    To  move  on,  the  learner  presses  the  return  key  to 
receive  an  activity  question.    The  instructional  display  is  removed  prior 
to  the  presentation  of  each  of  the  57  activity  questions.    Hie  learner 
responds  to  the  activity  question  by  typing  in  the  correct  response.  The 
program  accepts  not  only  the  standard  spelling  for  correct  answers  but 
plausible  misspellings  as  well.     If  the  correct  response  is  entered, 
correct  feedback  is  given  in  the  form  of  simple  feedback  (i.e.,  right, 
correct,  got  it,  etc.).     If  an  incorrect  answer  is  typed  in,  simple 
feedback  is  given  that  the  response  is  incorrect.    The  student  is  then 
given  the  option  of  receiving  elaborate  feedback,  which  is  the  repeat  of 
the  instructional  display.    However,  this  feedback  is  completely  optional; 
he  or  she  can  move  to  the  next  instructional  display  without  feedback.  A 
record  was  kept  for  each  subject  on  the  amount  of  feedback  options~Jtaken. 
Both  the  instructional  display  and  the  elaborate  feedback  aspect  of  the 
instructional  program  were  completely  self-paced. 

(2)  Externally  Paced  Program  plus  Cognitive  Processing  Time 
The  £P+Cp  instructional  program  is  externally  paced  at  the  point  of 

instruction  and  elaborate  feedback.    The  57  instructional  displays  are 
identical  to  the  SP  instructional  condition;  containing  the  same  content, 
in  the  same  order,  with  each  display  generated  in  the  same  way,  and  at  the 
same  rate.    However,  the  external  pacing  begins  after  the  instructional 
display  is  completed.    After  each  instructional  display  is  completed,  the 
program  times  the  student's  interaction  with  the  completed  display  at  a 
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pace  of:     (a)  1  second  per  each  line  of  verbal  instruction,  plus  1  second; 
so  for  S  lines,  6  seconds  for  reading  are  given;  (b)  7  seconds  for 
cognitive  processing  are  then  given,  after  1  second  per  line,  plus  1 
second,  time  has  elepsed;(c)  after  reading  time  and  cognitive  processing 
time  has  elapsed,  the  instructional  display  is  removed  from  the  terminal 
screen.    To  move  ahead,  the  learner  presses  the  return  key  to  receive  the 
activity  question.    The  learner  has  as  much  time  as  required  to  respond. 
If  the  correct  answer  is  entered,  simple  feedback  is  given  and  the  student 
moves  to  the  next  instructional  display.     If  the  incorrect  answer  is  typed 
in,  simple  feedback  is  given  that  indicates  an  incorrect  answer.    As  in  the 
SP  condition,  the  learner  is  given  the  option  of  receiving  elaborate 
feedback,  which  is  the  repeat  of  the  instructional  display  containing  the 
required  answer.    The  elaborate  feedback  is  optional;  the  learner  can  move 
to  the  next  instructional  display  or  take  feedback.    Feedback  is  a  repeat 
of  the  instructional  display  and  is  timed  the  same  way,  not  allowing 
self -paced  elaborate  feedback.    Therefore,  in  the  EF+Cp  instructional 
program,  both  instruction  and  elaborate  feedback  are  externally  paced. 

(3)  Externally  Paced y  No  Cognitive  Processing  Time 

The  EP-Cp  instructional  program  is  externally  paced  at  the  point  of 
instruction  and  feedback.    The  57  instructional  segments  are  identical  to 
the  SP  and  EP+Cp  instructional  conditions;  containing  the  same  content,  in 
the  same  order,  with  each  display  generated  in  the  same  way,  and  at  the 
same  rate.    After  each  instructional  display  re  completed,  the  program 
times  the  learner's  interaction  with  the  now  completed  display  at  a  pace 
of:  1 

(a)  1  second  for  each  line  of  verbal  instruction,  plus  1  second  (i.e.,  S 
lines  of  written  instruction,  6  seconds  of  interaction  allowed). 

(b)  After  interaction  time  of  1  second  per  line  plus  1  second  passes,  the 
instructional  display  is  removed  from  the  screen. 

(c)  Cognitive  processing  time  of  7  seconds  is  not  allowed  in  the  EP-Cp 
instructional  condition. 

The  57  activity  questions  in  the  EP-Cp  instructional  condition  are 
identical  to  the  SP  and  EP+Cp  conditions.    The  learner  has  as  much  time  as 
needed  to  respond  to  the  activity  questions.    As  in  the  SP  and  EP+Cp 
conditions,  simple  feedback  is  given  after  the  learner  responds  to  the 
activity  question.     If  an  incorrect  answer  is  given,  the  learner  has  the 
option  of  receiving  elaborate  feedback,  or  moving  to  the  next  frame  of 
instruction.    The  elaborate  feedback  is  a  repeat  of  the  instructional 
display  containing  the  correct  answer.    However,  the  elaborate  feedback  is 
externally  paced  in  the  same  way  as  the  instructional  display,  thus  not 
allowing  self-pacing  at  the  point  of  instruction  and  elaborate 
feedback. 

(4)  Control 

To  determine  the  base  rate  of  the  subject's  pre -instructional  program 
knowledge  of  heart  physiology,  a  control  group  was  randomly  formed  from  the 
pool  of  100  subjects  participating  in  the  study.    The  control  group  took 
the  five  tests,  but  received  no  instruction.    The  control  group  method  was 
used,  as  opposed  to  a  pre-test  for  all  subjects,  because  it  was  felt  that  a 
pretest  would  serve  as  an  advance  organizer,  and  therefore  add  an  unwanted 
intervening  variable  to  the  study. 
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The  within  subjects  factor  represented  the  different  levels  of 
objectives,  or  learning  tasks ,  and  consisted  of  the  five  achievement  tests 
to  evaluate  the  amount  of  information  acquired  and  competency  level' with 
learned  information*    To  do  this,  the  five  tests  ranged  in  difficulty  from 
a  simple  memory  task  to  a  more  difficult  problem  solving  task.    Sach  of  the 
five  tests  contained  a  total  of  20  possible  points,  and  will  be  described 
according  to  level  of  intellectual  difficulty,  simple  to  difficult* 

(1)  J^£t_Learnio&  Tajik 

The  list  learning  task  was  a  simple  memory  task,  requiring  the  learner  to 
list  the  names  of  the  parts  of  the  heart. 

(2)  Spatial  Le a rn i ng_Ta s k , _Cued - Re£a  1^  1 

The  spatial  learning  task,  cued-recall,  consisted  of  20  multiple  choice 
items  designed  to  test  the  spatial  learning  of  heart  part  location.  The 
test  contained  a  line-drawing  of  th»  heart  with  numbers  and  arrows  \ 
indicating  where  each  part  was  located.    The  20  test  items  appeared  under 
the  numbered  drawing  and  required  the  subject  to  identify  specific  part 
locations. 

(3)  S irap l^e^C on£e£t_Le a r n £njj  Task 

The  simple  concept  learning  task  contained  20  multiple  choice  items.  Sach 
item  provided  in  the  item  stem  a  description  of  a  critical  attribute  about 
a  heart  part  or  operation.    The  learner  selected  the  heart  part  or 
operation  from  the  available  choices. 

(4)  Complex  Concept^  Learn  in  g_Task 

The  complex  concept  learning  task  contained  20  multiple  choice  items.  The 
items  were  complex  in  the  sense  that  they  involved  "if-then"  relationships* 
of  the  parts  of  the  heart  during  heart  operation,  or  what  could  be  defined 
as  disjunctive  concepts. 

(5)  j>patial^  Le  a  rn  i  n  g_Pr  ob  1  emx  Free^Recal_l 

The  sp^t'al  learning  problem,  free  recall  was  considered  the  most  difficult 
of  the  five  tasks.    The  learner  had  to  prepare  from  memory  a  line  drawing 
of  the  heart,  with  the  parts  in  the  correct  location  and  labeled.    Then  the 
learner  had  to  indicate  blood  flow  through  the  heart  pump  system,  by 
drawing  a  series  of  dotted  lines  connecting  how  the  parts  interact  during 
heart  operation. 

Subjects  participating  in  the  study  were  first  term  freshmen  enrolled 
at  Ohio  State  University.    There  were  100  subjects  that  participated  in  the 
study,  and  they  received  course  credit  towards  their  final  grade  in 
freshmen  psychology  for  their  participation.     Subjects  were  randomly 
distributed  by  the  experimenters  to  the  three  instructional  program 
conditions  and  the  control.    Each  instructional  program  group  had  25 
subjects,  and  the  control  group  contained  25  subjects.    Use  control  group 
took  the  five  achievement  tests  the  day  before  the  rest  of  the  study  was 
conducted  to  establish  a  base  rate  on  the  subject  pools1  knowledge  of  heart 
physiology.    As  can  be  seen  in  Table  1,  part  II,  the  control  failed  to  know 
the  names  of  the  parts  of  the  heart  or  the  heart  part  locations  and 
functions.    The  controls  acquired  score  on  the  three  multiple  choice  tests 
is  a  function  of  random  guessing.    As  can  be  seen  by  the  controls  overall 
average  score  of  (4.43)  points  on  the  five  achievement  tasks,  they  were 
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only  able  to  score  an  average  of  (22%)  across  all  tasks*    Based  on  this 
result,  it  was  determined  that  the  subject  pool  had  little  prior  knowledge 
of  heart  physiology*    The  study  was  conducted  during  the  following  day* 
Three  two-hour  time  periods ,  over  a  period  of  one  day,  were  blocked  off  for 
each  of  the  three  instructional  program    types,  beginning  with  the  SP 
group,  followed  by  the  EP+Cp  group,  and  then  the  EP-Cp  group.    All  three 
groups  were  given  instructions  that  they  would  be  working  through  a 
micro-computer  instructional  program  on  heart  physiology.    The  groups  were 
not  aware  of  any  differences  in  the  programs,  nor  were  they  aware  that  opts 
for  feedback  and  overall  time  for  instructional  program  completion  were 
being  monitored.    After  these  simple  instructions  were  given,  the  subjects 
went  to  the  micro-computer  lab  to  work  through  their  instructional  programs. 
When  they  completer1  their  instructional  program,  they  returned  to  the 
classroom  to  take  the  five  achievement  tests.    The  two  free  recall  tests 
were  administered  first  to  avoid  subjects  attaining  cues  from  the 
multiple-choice  tests.    After  completing  the  two  free  recall  tests,  the 
three  multiple-choice  tests  were  administered. 


Resulting  Data 

Analysis  of  the  resulting  experimental  data  from  the  Lindquist  Type -I 
design  appears  in  Table  I,  part  I,  and  the  between  subjects  mean,  within 
subjects  mean  and  simple  effect  means  are  presented  in  Table  I,  part  II. 

The  analysis  of  variance  results  in  a  significant  F-ratio  on  the 
between  subjects  variable  of  instructional  program  pacing,  [F(3,96  Df)  * 
45.875,  £  .001].    A  Tukey  follow-up  test  was  conducted  on  the  between  subject 
means,  with  a  significance  level  set  at  (.05).    The  three  experimental  group 
means  [ (SP,X-10. 57)(EP+CptX-12.22)(EP-CptX«9.02) ]  differ 
significantly  from  the  control  [  C,X«4.43]._  The  EP+Cp  mean  [X-12.22] 
differs  significantly  from  the  EP-Cp  mean  [X-9.02J.    However,  while  the 
EP+Cp  mean  did  not  differ  significantly  from  the  SP  mean,  the  EP+Cp  mean  is 
greater.    The  SP  mean  does  not  differ  significantly  from  the  EP-Cp  mean. 

The  within  subjects  variable  of  task  difficulty  resulted  in  a 
significant  F-ratio;  however,  there  was  a  significant  interaction  between 
instructional  program  pacing  and  task  difficulty  [£(12,384  Df)*10.485, 
£  .001].    To  find  the  source  of  the  interaction  a  Tukey  follow-up  test  was 
used,  set  at  a  significance  level  of  (.05).    The  significant  interaction  is 
graphically  displayed  in  Figure  2.    The  source  of  the  interaction  is  found 
in  the  EP+Cp  instructional  program  condition.     In  the  EP+Cp  condition,  as 
task  difficulty  increased  across  the  first  four  achievement  tests,  the 
performance  competency  of  the  EP+Cp  subjects  remained  constant.    Even  at 
the  most  difficult  achievement  test  level ,  the  spatial  problem,  the  EP+Cp 
group  performed  significantly  better  than  the  EP-Cp  group,  and  slightly 
better  than  the  SP  group.    The  SP  group  bad  a  significant  decrease  in 
performance  competency  as  task  difficulty  increased ,  yielding  a  significant 
decrease  in  performance  between  the  complex  concept  task 
[  X-10.40] ,  list  learning  task  [X-12.36],  and  spatial 
learning  task,  cued  recall  [X-12.32].     Similar  results  occurred 
with  the  EP-Cp  condition,  finding  a  significant  drop  in  performance  between 
their  list  learn  task  mean  [X"11.84],  and  simple  concept  task 
and  complex  concept  task  means  [ (X*8.88) ; (X"9.48) ] . 


ERIC 


8 


Additionally ,  at  the  EF-Cp  level ,  the  spatial  learning,  cued-recall  task 
mean  [X»10.64J  differed  significantly  from  the  simple  concpc 
task  mean  [X-8.88],  and  their  performance  competency  on  the 
spatial  problem  was  quite  low  [X«4.28] • 

The  significant  interaction  finds  support  for  the  first  hypothesis, 
indicating  that  moderate  levels  of  external  pacing  of  a  micro-computer 
instructional  program  tended  to  allow  for  more  content  information  to  be 
attained,  and  allowed  for  a  higher  level  of  competency  performance  with 
learned  information  over  a  self-paced  instructional  program*    Support  is 
found  for  the  second  hypothesis,  indicating  that  aft  externally  paced 
instructional  program  would  allow  for  more  efficient  learning  than 
self-paced  alone.    Looking  at  the  average  time  for  completion  of  the  three 
instructional  programs  (Table  1,  part  II)  finds  the  EP+Cp  group  to  be  more 
efficient  than  the  SP  group  [EP+Cp«44.64  min. ;  SP-50.36  min.;  EP-Cp«45.04 
min. ] . 

In  many  micro-computer  instructional  programs,  the  learner  is 
permitted  to  opt  for  elaborate  feedback  in  the  form  of  additional 
instruction.    However,  it  is  likely  that  higher  test  achievers  will  tend  to 
opt  for  elaborate  feedback  more  often  than  lower  test  achievers,  even 
though  lower  achievers  actually  need  the  elaborate  feedback  or  additional 
instruction  more  than  their  higher  achieving  counterparts.    This,  of 
course,  would  indicate  that  learner  control  over  needed  additional 
instruction  may  not  be  appropriate*    The  third  hypothesis  was  tested  by 
comparing  opts  for  feedback  of  higher  achievers  on  the  five  tasks,  as 
defined  by  the  six  subjects  having  the  highest  test  scores  in  each  pacing 
condition,  and  the  lower  achiever  opts  for  feedback.    Lower  achievers  were 
defined  as  the  six  subjects  in  each  instructional  pacing  condition  with  the 
lowest  achievement  test  scores.    An  analysis  of  variance  was  conducted 
comparing  opts  for  feedback  between  higher  achievers  and  lower  achievers, 
at  each  of  the  instructional  pacing  conditions.    The  resulting  analysis  is 
summarized  in  Table  2.    A  significant  F-ratio  occurred  on  the  feedback  opts 
variable  [F(l,30  Df)»192.47,  £  .0001].    This  result  supported  hypothesis 
three,  finding  that  those  subjects  defined  as  higher  achievers  selected 
elaborate  feedback,  (X-86.56X)  of  the  time,  when  an  error 
was  made  on  an  activity  question  during  instruction.    Those  subjects 
defined  as  lower  achievers  selected  elaborate  feedback  (X«29.72Z) 
of  the  time,  when  an  error  was  made  on  an  activity  question  during 
instruction. 


Discussion  of  Resulting  Data 

Results  of  the  present  study  indicate  that  self-paced  instructional 
methods  for  micro-computer  based  instructional  programs  (MCBI)  may  not 
always  be  the  best  method  of  addressing  individual  learning  differences. 
The  decision  is  often  made  by  instructional  specialists  working  with  MCBI 
to  build  instructional  programs  to  be  self-paced,  simply  because  the 
micro-computer  is  well  adept  at  self-pacing.    Additionally,  many  of  the 
past  efforts  at  accommodating  for  individual  learning  differences,  have 
been  to  design  instructional  systems  around  the  relative  benefits  of 
self-pacing  (Cross ,  1976) •    However,  when  considering  a  cognitive 
psychology  paradigm  of  improving  learning,  the  variables  of  attention  and 
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motivation  should  not  be  ignored**   Since  attending  behavior  and  motivation 
are  key  psychological  elements  in  the  learning  process  (Wittrock,  1979) ,  it 
is  likely  that  by  manipulating  these  variables ,  learning  outcomes  can  be 
changed. 

The  present  study  demonstrated  that  during  a  self -paced  instructional 
program  subjects  behaved  differently,  in  terms  of  amount  learned  and 
performance  competency  with  learned  material ,  than  subjects  in  a  moderate 
externally  paced  instructional  program  condition.    It  is  likely  that  this 
element  of  moderate  external  pacing  caused  subjects  in  this  condition  to  be 
more  motivated  to  interact  with  each  instructional  diaplay  and  attend  to 
information  in  each  display  more  carefully.    The  EP+Cp  instructional 
program  condition  caused  a  significant  increase  in  learning  and  performance 
competency9  even  on  the  more  difficult  tasks.    This  result  indicatea  that 
moderate  levels  of  external  pacing  can  improve  overall  learning ,  and  that 
self-pacing  may  not  always  be  the  best  methodology  for  MCBI.  However, 
learning  performance  was  significantly  impaired  by  eliminating  the  7 
seconds  of  cognitive  processing  time  in  the  EP-Cp  instructional  program 
condition.    Apparently,  thia  slight  change  in  pacing  increased  motivation 
to  a  point  where  cognitive  information  processing  deteriorated.    This  fits 
the  Yerkes-Dodson  Law  quite  well  (Travers,  1972),  and  indicates  that 
moderate  external  pacing  is  defined  as  external  pacing  allowing  a 
reasonable  amount  of  time  for  mental  interaction  with  the  generated 
instructional  display.    In  other  words,  external  pacing  can  increase 
attending  and  motivation  resulting  in  improved  learning,  but  it  cannot  be 
too  extreme. 

V 

On  the  issue  of  opting  for  elaborate  feedback,  or  additional 
instruction,  it  would  seem  that  the  students  that  may  need  elaborate 
feedback  the  most,  are  those  less  likely  to  opt  for  it.    This  fesult  fits 
Carrier's  (1984)  conclusion  that  students  may  not  be  the  best  judges  of 
what  instruction  they  need,  and  how  much  instruction  they  need,  for 
effective  learning  to  take  place.    However,  many  instructional  designers 
build  MCBI  programs  that  may  have  elaborate  feedback  available,  but  only 
recommend  to  learners  that  such  feedback  is  needed.    It  may  be  necessary  to 
force  learners  into  elaborate  feedback  loops,  or  remedial  instruction 
loops,  if  they  are  making  a  significant  amount  of  errots  on  activity 
questions  cr  instruction  post  tests. 


Conclusion 

The  purpose  of  this  study  was  to  investigate  the  axiom  that  when 
learners  are  permitted  to  interact  with  self -paced  instructional  materials, 
ror  as  long  as  is  perceived  necessary  to  acquire  academic  content 
materials,  learning  will  be  optimum.    Results  obtained  from  this  study 
provide  evidence  which  indicatea  that  when  students  are  permitted  to 
exercise  freedom  through  instructional  sequences,  learning  is  not  optimised. 
The  data  also  yields  evidence  which  shows  that  varied  types  of  self-paced 
micro  computer  instructional  strategies  are  not  equally  effective  in 
facilitating  student  achievement  of  identical  instructional  objectives. 
Further,  these  results  indicate  that  complete  learner  control  ove# 
feedback,  for  micro  cpmputer  instructional  programs,  should" be  used  with 
caution  since  one  cannot  assume  that  students  who  require  further 
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instruction  will  actually  engage  in  further  instructional  work  via 
branching  options  or  elaborate  feedback  options. 

External  pacing  of  MCBI  applications  should  be  investigated  further , 
using  different  types  of  academic  content  and  different  ^ypeb  of 
instructional  objectives.    Additionally,  a  variety  of  external  pacing 
methods  should  be  considered  for  MCBt  learning  systems,  and  the  effect  of 
these  methods  should  4>e  evaluated  on  learners  with  different  cognitive 
styles  (i.e. ,  field-dependents-independents f  ref lecti^e s- impulsive s ,  etc. ) . 
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Source 

Mean  Sq. 

Df 

F-ratio 

Probability 

I  BETWEEN  GROUPS 

i     Pacing  (A) 
I  Error 

1404.359 
30.613 

3 
96 

45.875 

.001 

1 

I    WITHIN  GROUPS 

i  Learning 
i     Task  Diff  (B) 
1      (A)  x  (B) 
I  Error 

493.217 
51.901 
4.949 

4 
12 
384 

99.785 
10.485 

.001  ! 
.001  ! 

Table  1,  Part  I:    Lindquist  Type -I  Resulting  Data. 


i                  |  Self -Paced!  External    1    External  1  Control 
!                  1                  1  Pace.  Noral    Pace  1 
|                 |                 I  Reading     I    No  Cp  ! 
I                 |                 |  Speed  +  Cpj  1 

WG t  X. •  1 
Control  1 
In  I 

|  List  Partsj                  1  1 

|  (List         I      12.36     1      12.48     |  11.84 

I  Learning)  I                  i  1 

r  l 

1.92 

9.65  ! 

I  Spatial     1                  i  1 

|  Learning,  j      12.32     1      13.60     1  10.64 

I  Cued-Rcall]                   1  1 

5.68 

10.56 

1  Simple       1                  1  1 

I  Concept     |      11.00     !     12.80     i  8.83 

1  Learning    E                   I  1 

7.12 

9.95 

I  Complex      I                   !  1 

j  Concept     I      10.40     1     13.64     I  9.48 

j  Learning   1                  1  i 

6.56 

10.02 

I  Spatial 
|  Learning 
Problem t 
Free -Res 11 

6.76 

8.60 

4.28 

.88 

5.13 

10,  _ 

 iiJil— 

Avg.  Time 
i  Overall 

50.36 
min. 

44.64 
min. 

45.04 
min. 

n/a 

Table  1,  Part  II:    Resulting  Means  and  Overall  Time  to 

Complete  Instructional  Program 
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Source 


Mean  Sq. 


F-ratio     Probabil;>y  1 


Between 
Groups 

Pacing  (A) 

Feedback 
Opts  (B) 

(A)  x  (B) 

Error 


241.861 

29070.25 
86.583 
151.039 


1 
2 
30 


1.6 


.22 


192.47  .0001 
.57  .57 


Significant  Means  High  6  vs.  Low  6: 
Feedback  Opts,  High  6  (X-86.56%), 

Feedback  Opts,  Low  6  (X-29.722) 


Table  2:     Anova  results  on  feedback  options  of  hightest  scoring 
*        6  and  lowest  scoring  6  and  significant  means. 
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Using  Video  ta  Study  Cognition 


Piaget's  (1977)  new  model  of  equilibration  has  engendered  a  move  among 
cognitive  psychologists  towards  functionalist,  incorporating  a  study  of 
mi crodevelopment ,  rather  than  macrodevel opment ,    and  focusing  on  problem 
solving  strategies  and  compensations,  rather  than  stages.    Three  aspects 
inherent  in  the  learning  process  have  been  expanded  from  the  earlier  model 
and  detailed:  <1>  sel  f-regul  at  i  o.i ,  <2)  conflict  resolution,  and  (3)  reflexive 
abstract  i  on • 


Self-reoulat  ion 

Self-regulation  refers  to  the  active  processes  of  assimilation  and  , 
accopmodat i on .    As  biological  organisms,  learners  are  constantly 
restructuring  and  adapting*    They  make  relations  and  inferences  about  actions 
and  events  and  then  test  out  these  inferences  in  an  attempt  to  make  meaning 
out  of  the  world* 

According  to  Kuhn  and  Ho  (1977)  the  importance  of  self-regulation  has 
probably  been  underestimated  by  educators.    These  researchers  asked  children 
to  determine  an  unknown  variable  in  the  basic*  i  sol  at  ton  of  chemical  task. 
Some  children  were  allowed  to  plan  their  own  sequence  of  steps,  in  effect  to 
test  out  their  own  hypotheses.    Others  served  as  yoke  controls  and  were 
required  to  do  the  same  steps  as  their  yoke.    In  other  words,  the 
experimental  group  decided  what  chemicals  to  mix  in  order  to  determine  the 
correct  combination  of  elements  in  Beaker  x.    The  control  group  was  told  by 
the  researchers  which  chemicals  to  mix,  the  directions  determined  by  whatever 
actions  were  performed  by  the  yoke  in  the  experimental  group.    Hence  the 


Aspects  Inherent  i n  Learn i no 
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subjects  in  the  control  group  performed  the  identical  actions  but  they  could 
not  test  their  own  hypotheses.    Higher  level  strategi es  were  found  to  exist 
on  a  similar  task  serving  as  a  posttest  for  those  subjects  allowed  to  test 
their  own  hypotheses. 

Conf  1  ict  ResoVutj  on 

A  study  by  Karmi  1  of  f-Smi  th  and  Inhelder  <1?74)  illustrates  the 
importance  of  conflict  resolution.    These  researchers  studied  children'* 
construction  of  theories  about  balance  by  giving  children  (ages  3-7  years) 
symmetrical  blocks,  asymmetrical  blocks,  and  blocks  with  hidden  weights  to 
balance  on  a  fulcrum.  They  found  that  the  youngest  children's  actions  were 
representative  of  their  egocentric  schemes.    They  just  'plunked0  each  block 
on  the  fulcrum,  with  no  lateral  shifts  across  the  fulcrum  to  find  the  balance 
point.    Their  compensat i ons ,  when  blocks  did  not  balance,  consisted  of 
claiming  that  the  block  was  an  impossible  block  to  balance  or  of  pushing 
harder  on  the  block  above  the  point  of  contact  with  the  fulcrum.    Since  these 
actions  obviously  did  not  produce  success,  children  began  to  explore  the 
properties  of  the  blocks  and  to  try  different  positions  on  the  fulcrum. 
Reflection  on  these  actions  brought  about  a  focus  on  the  procedures  which 
worked  (lateral  shifts)  and  eventually  the  construction  of  a  theory  about 
balance  which  was  assumed  to  work  for  all  blocks.    The  first  theory 
constructed  was  a  "center"  theory  (find  the  middle  of  the  block  and  it  will 
balance).    This  theory  was  over-generalized  across  all  blocks  regardless  of 
whether  the  block  was  asymmetrically  weighted.    In  testing  out  their 
theories,  children  met  with  conflict.    Eventually,  through  conflict 
resolution,  more  stable  theories  of  balance  in  relation  to  weight  were 
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In  a  microanalysis  of  this  data,  -Karroi lof f-Smi th  and  Inhelder  found  that 
children  without  a  general  theory  were  success-oriented  and  reflected  only  on 
actions  and  procedures  which  worked.    In  contrast,  children  who  began  wi-ih 
theories  had  a  theory-testing  orientation  to  the  task  and  thus  were  led  to 
either  confirm  or  disconfirm  their  theories  in  action.    This  theory  testing 
behavior  led  to  the  eventual  construction  of  a  new  one.    Even  a  wrong  theory 
was  more  helpful  than  no  theory  in  the  long  run.    Hence,  the  title  of  their 
article,  "If  you  want  to  get  ahead,  get  a  theory. 9 

Ref 1  ex  i  ve  Abstract  ion 

The  third  process  in  learning  identified  by  Piaget  and  the  Genevan 
School   is  reflexive  abstraction.    This  process  is  defined  by  Gallagher  and 
Re  i  d  as; 

"•....the  reflection  process  through  which  one  derives 
information  from  oner's  own  actions  and  from  the  coordi- 
nation of  actions  (putting  them  into  correspondences, 
linking  them,  and  so  forth).    It  provides  the  links 
between  and  among  experiences  and  can  be  detected  even 
in  the  very  earliest  and  most  elementary  behavior  of 

infants,    Reflexive  abstraction  has  two  aspects:  a 

\ 

\ 

projection  from  a  lower  to  a  higher  level — for  example, 
from  the  sensorimotor  level  to  the  level  of  thought — 
and  a  reorganization  or  reconstruction  of  knowledge  at 
the  higher  level."  (Gallagher  and  Reid,  1931,  p.    235)  \ 
P*aget  (1977)  di  st  i  ngu  i  shes,  re-f  1  ex  i  ve  abstraction  -from  fa  lower  level 
abstraction  which  he  calls  empirical  abstraction.    He  de-fines  empirical 
abstraction  as  the  reflection  occurring    n  relation  to  the  dbservables  of  the 
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objects.     In  the  case  of  tbe  blocks  in  "the  af orment i oned  study  by  Karmiloff- 
Sffiith  and  Inhelder,  the  empirical  abstractions  would  be  in  relation  to  the 
size,  shape,  weight  of  the  block.    In  contrast,  reflexive  abstraction 
pertains  to  the  reflection  which  generates  theories  about  balance  in  general. 
Of  most  importance,  however,  is  the  fact  that  empirical  abstractions  lead  to 
reflexive  abstractions.    In  Piaget's  model,  reflection,  is  seen  as  a 

spiralling  process,  each  reflection  bringing  the  learner  to  higher  levels. 

j,  *  « 

The  Problem 

While  these  aspects  of  learning  have  been  well  delineated  by  Piaget, 

7 

they  have  rarely  been  empirically  and/or  statistically  validated.  A  ^ 
microanalyses  of  the  compensations  of  a  few  subjects  has  usually  been  deemed 
syLf  f  « c  i  ent . 

Current  technology  allows  the  researcher  the  opportunity  to  record  and 
explore  these  aspects  from  a  naturalistic  paradigm  and  then  to  test  them  in 
an  empirical  fashion.    For  example,  video  affords  the  researcher  the  ability 
to  film  individually  a  large  number  of  subjects  of  different  ages  solving  a 
problem.    These  film  clips  can  then  be  analyzed  m i croanal yt i cal I y  using  stop- 
action,  fast  forward,  and  replay  to  illuminate  the  regulations  of  the 
subjects.    Hypotheses  can  then  be  made  and  tested  statistically. 

*    The  remainder  of  this  paper  is  the  report  of  a  study  using  stop-action 
video  cf  a  problem  solving  task  with  such  an  approach.    The  first  part  of 
this  study  is  a  replication,  statistical  validation,  and  extension  of  the 
Karmi  loff-Smi  th  and  Inhelder  study  of  balance.    It's  purpose  was  to  provide 
empirical  validation  of  the  ordi na1 ' 1  eve  I s  as  psychologically  discrete 
behaviors  and  as  comprising  a  heirarchical  srale. 
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Part  I :  Natural ist ic  Observations 


Vaj idat ion  of  Ordinal  Scale 


Method 


Subjects 


Sixty-four  girls  and  44  boys  whose  ages  ranged  from  48  to  96  months 
served  as  subjects  in  the  study.    The  mean  age  of  the  group  was  72  months. 
Mater  i  al s 

Mater  ials  ^consisted  of  a  1/4  inch  fulcrum  raised  along  the  length  of  a 

platform  6*  x  10"  and  a  series  of  blocks  to  be  balanced,  modified  from  the 

Karmi I  of f-Smi th  and  Inhelder  task.    For  purposes  of  scoring  placement,  the 

bottom  plane  of  each  block  had  five  imaginary  points.    The  blocks  were 

further  classified  by  clusters  which  were  felt  to  invqke  the  same  theoretical 

principle  of  balance  <*see  Figure  1). 

A  group  of  "helper  blocks"  was  also  provided  each  subject  to  use  as 

t 

he/she  wished.    All  helper  blocks  were  painted  blue,  to  contrast  with  the 
blocks  for  balancing  which  were  painted  green.    There  were  six  helper  blocks 
in  alls  two  2-3/4  x  2-3/4  x  1-7/8  inches,  one  1-3/8  x  1-3/8  x  1-7/8  inches,- 
and  two  5-1/2  x  2-3/4  x  1-7/8  inches. 


Each  child  was  brought  individually  to  a  testing  room  (adjacent  to  the 
classroom)  by  a  female  experimenter.    The  child  was  seated  at  a  low  table 
with  the  blocks  to  be  balanced  placed  to  his/her  right  and  the  "helper 
blocks"  to  his/her  left.    The  fulcrum  was  taped  to  the  table  in  front  of  the 


Procedure 
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child*    The  child  was  asked  by  the  experimenter  to  try  to  balance  each  of  the 
blocks,  one  at  a  time,  on  the  fulcrum.    After  each  block  was  tried  it  was 
removed  so  that  the  subject  tried  each  block  only  once.    Subjects  were 
videotaped  as  they  tried  each  block*    Video  equipment  was  obscured  from  the 
subject's  view. 
Measures 

Strattoy  scale.    A  scale  was  drafted  frora  an  analysis  of  the  Karml loff- 
Sroi th  and  Inhelder  study,  assessing  the  degree  to  which  the  child's 
performance  indicated  a  theory  testing  orientation  to  the  task.    The  use  of 
the  helper  blocks,  direction  of  lateral  corrections  across  the  fulcrum, 
anticipation  of  the  effect  of  such  factors  as  area  or  weight,  and  the  degree 
to  which  the  child  tested  out  his/her  theories  about  balar  :e  were  all  factors 
taken  into  account  in  constructing  this  scale.    The  scale  was  refined  through 
pilot  testing  and  expanded  to  incorporate  five  construct  levels  comprised  of 

13  operat i onal i zed  behaviors  as  follows: 
Level  1  .  Eoocentr ic 

1.1  This  behavior  is  characterized  by  an  ego  orientation 
to  all  the  blocks.    In  other  words  the  child  believes  that 
his/her  actions  should  balance  the  block;  blocks  are  placed 
at  any  point  erratically  on  the  fulcrum  and  let  go,  or  pushed 
hard  above  the  point  of  contact,  or  held  horizontally  in 
place.    No  lateral  shifts  across  the  fulcrum  to  find  the 
center  of  gravity  occur.    In  fact  the  child  at  this  level 
frequently  describes  the  block  in  terms  of  a  seesaw,  having 
an  'up*  and  a  "down*  side.    He/she  pushes  down  on  one  side  or 
holds  the  other  side  up  but  only  one  side  at  a  time  is  the 


9 

ERLC 


focus. 

1.2   This  behavior  is  still  characterized  by  an 
egocentric  orientation  although  it  represents  a  beginning 


/7* 


BEST  COPY  AVAILABLE 


decentration  off  a  reliance  on  the  self  to  a  focut  on  the 
block  and  its  properties.    Different  dimensions  of  the  block 
are  tried  as  well  as  different  points  of  contact  with  the 
fulcrum.    In  place  of  a  hand,  helper  blocks  are  used  under 
the  block  to  be  balanced  in  order  to  "hold  the  down  side  up.* 
Even  though  the  properties  of  the  block  are  beginning  to  be 
questioned,  no  lateral  movements,  no  rotations,  occur. 
Level  2i  Visual  Center  of  the  Bottom  Plane  Theory  (VCB) 

2.1  Although  a  child  on  this  level  originally  places 
the  block  on  the  fulcrum  in  an  egocentric  fashioj,  lateral 
shafts  begin  to  occur.    At  first  the     .-e  towards  the 
midpoint  of  the  bottom  plane  of  the  block.    The  child  appears 
to  be  beginning  to  form  a  theory  (general  principle)  about 
balance,  e.g.  all  blocks  will  balance  if  you  shift  to  th*. 
middle  of  the  bottom  plane  of  the  blocks.    The  child  does  not 
yet  have  a  stable  " theory- in-act ion"  but  is  beginning  to  test 
out  variables  that  might  produce  success.    As  the  child 
experiments  with  lateral  movements,  he/she  discovers  that  the 
overhangs  of  the  block  are  related.    A  shift  can  make  the 
"up"  side  go  down  and  the  "down"  side  go  up. 

2.2  This  behavior  is  demonstrative  of  the  first  real 


theory.    The  child  believes  the  midpoint  of  the  bottom  plane 
of  the  block  jto  be  the  exact  point  of  balance.    He/she  in 
fact  struggles  through  measurement  or  lateral  corrections  to 
find  this  point.    The  original  placement  is  a  VCB  (visual 
center  of  the  bottom  plane)  placement,  with  the  expectation 
that  this  is  the  correct  placement,  rather  than  an  ego 


BEST  COM  AVAILABLE 


oriented,  randan  placement. 

2.3   Although  the  child  at  this  level  still  originally 
places  the  block  at  its  VCB,  siftce  this  strategy  does  not 
work  for  many  of  the  blocks,  the  child  begins^to  test  out 
whether  the  visual  center1  (midpoint)  of  the  whole  block 
(rather  than  the  bottom  plane)  is  a  better  theory.  For 
example,  blocks  «1  and  N2  have  a  VCB  at  point  2.  This 
original  placement  will  not  success."  j1  ly  balance  the  blocks. 
The  child  shifts  the  block  towards  point  3. 
Level  3.    Vi sual  Center  Theory  CVC) 

3.1  The  distinction  between  levels  two  and  three  is 
that,  whereas  the  placements  in  level  two  were  all  around  or 
at  the  VCB,  the  original  placement  at  this  level  is  a 
bisection  of  the  whole  block  in  order  to  find  the  midpo/nt. 
Specifically,  at  irvel  two,  blocks  in  clusters  two  and  five 
were  placed  originally  at  point  2  and  then  shifted  to  point 
3.    By  level  three,  the  child  is  certain  that  the  whole  block 
must  be  bisected  and  thus  places  these  specified  blocks  at 
point  3  or iginal ly. 

3.2  This  behavior  is  characterized  by  the  use  of  helper 
blocks.    However,  this  time  they  are  placed  on  top  of  the 
block,  rather  than  underneath  for  support.    Importantly,  they 
are  placed  on  top  of  the  "up"  side  to  make  the  "down"  side 
come  up.    This  fact  suggests  that  the  child  is  testing 
whether  adding  a  block  to  the  main  biock  will  affect  balance. 
Although  helper  blocks  are  used,  all  blocks  are  placed  and 
remain  at  point  3.  /  T4/" 
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3.3   This  behavior  begins' wi  th  an  original  VC  placement 
but  the  child  shifts  the  block  towards  the  side  with  the 
greater  area.    Since  the  VC  was  the  original  placement  this 
^behavior  Is  still  classified  as  representative  of  a  visual 
center  theory.    This  behavior  is  most  obvious  with  blocks 
117,8,?, 13,  and  10.    Interestingly,  this  action  occurs  even  in 
block  H10,  even  though  these  corrections  are  away  from  the 
obvipusly  more  heavily  weighted  side! 
Level  4 .    Area  Center  Theory  <AC) 

4.1  This  behavior  suggests  that  the  child  has  given  up 
the  insufficient  theory  about  the  visual  center  and  now 
assumes  that  weight  is  a  factor.    However ,  weight  is 
determined  by  visual  cues?  bigger  space  is  assumed  to  weigh 
more.    Original  placements  are  toward  the  side  with  the 
greater  area  (e.g.,  point  2  on  bloctcs  #7,  8,  9,  13,  10). 
Since  the  child  seems  sure  of  this  placement  as  the  only  , 

C 

"correct"  one,  all  corrections  consist  of  a  struggle  to  f in{\ 
balance  around  point  2. 

4.2  Here  the  child  begins  to  question  whether  greater 
space  is  really  analogous  to  greater  weight.    In  the  facw  of 
conflict,  he/she  reverts  back  to  an  earlier  theory  and  uses 
the  visual  center  as  an  anchor  point.    Corrections  are  made 
both  towards  the  weighted  side  and  the  side  with  greater 
space,  depending  on  the  block.    For  example,  Cluster  3  blocks? 
are  originally  placed  at  point  3  and  corrected  towards  pcint 
2;  Cluster  4  blocks,  in  contrast,  are  originally  placed  at 
point  3  and  then  corrected  towards  -point  4.4I ' 
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4.3   This  behavior  is  characterized  by  a  reaffirmation 
about  the  need  to  bisect  the  area  of  the  block.  Thus 
original  placements  are  again  at  this  bisection  <point  2  for  " 
Cluster  3).    Corrections  are  made,  in  contrast  to  4.1  toward 
the  more  heavily  weighted  side. 
Level  5.    Ueiqh»T  Theory  Ml 

5.1  Here  the  child  has  finally  constructed  a  theory 
about  weight  and  understands  that  it  is  the  weight  that  must 
be  bisected  by  the  fulcrum.    Thus,  the  original  placement  is 
an  estimate  of  this  bisection,  point  4  on  the  weighted 
blocks.    Corrections  consist  only  of  a  struggle  to  find  this 

\  midpoint. 

5.2  This  last  behavior  entails  production.    Because  the 
*         child  has  a  stable  understanding  of  weight,  he/she  knows  that 

helper  blocks  must  be  added  to  the  impossible  blocks  (Cluster 

\       3),    He/she  adds  helper  blocks  and  then  makes  the  appropriate 

lateral  shifts  to  find  the  balance  point,  evidence  that  the 

reciprocal  nature  of  distance  and  weight  is  understood. 
This  ordinal  scale  was  further  operational ized  in  terms  of  expected 

behavior  for  each  of  the  blocks  thus  defining  an  idealized  profile  for  each 

level.    For  example,  a  child  at  level  2.2  <VCB>  should  place  the  length 

blocks  at  point  3  originally  and  struggle  with  this  area  searching  for  the 

midpoint.    The  displaced  base  blocks,  in  contrast,  would  be  placed  originally 

and  corrected  around  the  visual  center  of  the  bottom  plane,  point  2.  The 

same  placement  would  occur  with  the  impossible  blocks.    Wi  th  the  asymmetrical 

and  weighted  blocks,  point  3  aga'in  becomes  the  focus  even  though  these 

4,w         1 7R 


attempts  at  balancing  are  unsuccessful.  The  child  just  deems  these  as  "hard- 
blocks." 

Two  raters,  blind  to  the  age  of  the  child,  viewed  the  video  tapes  and 
assigned  each  child  to  one  of  the  13  behavioral  profiles.    Since  there  were 
cases  where  children  did  not  exhibit  a  perfect  fit  to  an/  one  of  the  13 
idealized  profiles,  the  raters  double  coded  20%  of  all  video  tapes.  The 
interrater  reliability  score  was  84%  based  on  the  number  of  perfect  matches 

* 

divided  by  the  number  of  subjects  double  codec. 

pluster  Score 

The  blocks  were  categorized  (see  Figure  1)  into  clusters  tfhich 
ostensibly  tapped  the  same  level  of  understanding.    For  instance,  Cluster  1 
should  be  the  easiest  group  of  blocks  to  balance  since  each  block  could  be 
balanced  successfully  with  a  theory  about  bisecting  .the  base  of  the  bfbck . 
Cluster  2  tapped  the  abstraction  of  bisecting  the  whole  blocK  rather  than 
just  the  base.  Cluster  3,  the  asymmetrical  blocks,  should  be  passed  by 
subjects  holding  a  theory  about  area  as  analogous  to  weight.    The  weighted 

blocks,  Cluster  4,  should* only  be  passed  by  subjects  having  an  understanding 

\ 

about  weight.    Cluster  5,  the  impossible  blocks,  should  be  the  most  difficult 
clus.er  since  it  required  an  understanding  of  the  need  not  only  to  add 
counterweight,  but  also  to  move  the  block    on  the  fulcrum  to  equally  balance 
that  weight. 

In  order  to  alleviate  the  -possibi 1 i ty  that  success  could  occur  by  chance 
this  measure  was  made  very  stringent.    Every  block  in  the  cluster  had  to  be 
balanced  successfully  before  the  subject  was  coded  as  passing  that  respective 
cluster.    It  was  assumed  that  for  subjects  to  pass  a  cluster  they  had  to  make 
an  inference  about  how  the  blocks  in  that  cluster  were  alike  and  then 
struggle  with  them  to  find  the  exact  balance  point.    Subjects  were  given  a 
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score  of  pass  or  -fail  on  each  cluster. 

Resul ts  * 

Strategy  Scale 

The  Spearman  Correlation  Coefficient,  appropriate  for  non-parametric 
measures,  was  derived  yielding  r«.43,  p».0Qt  lor  agt  and  level.    In  order  to  0 
further  assess  discreteness  between  levels  the  13  operational i zed  behaviors  " 
.+  were  combined  into  the  five  construct  revels  which  they  tapped.    Bonferroni  i 
tests  assessing  mean  age  differences  between  levels  were  significant  at  .05. 
Mean  ages  C in  months)  for  each  level  were  So, 44 ,74, 83, 90  respectively.  . 
Cluster  Score 

A  Guttman  scalogram  analysis  was  performed  to  test  the  hypothesis  that  aN 
difficulty  order  existed  from  one  to  five  and  that  subjects  passing  Cluster  2 
had  also  passed  Cluster'  1;  subjects  passing  Cluster  3  had  also  passed  Clus.ter 
1  *nd  2,  etc.    The  coefficient  of  reproducbi I ity  was  .95  with  a  coefficient 
of  scalabi 1 i  ty  at  .80. 

e 

pi  scussi  on 

f 

The  data  clearly  substantiated  the  predicted  ordinal  scale  of 
strategies.    The  youngest  children  attempted  to  balance  the  blocks  by 
egocentr ically  placing  them  at  random  points  on  the  fulcrum.    If  the  block 
fell,  which  happened  frequently,  thty  declared  that  the  block  could  not  be 
balanced.    The  f irst  corrections  observed  were  towards  the  middle  of  the 
bottom  plane  of  the  blocks,  even  when  these  corrections  were  obviously  in, 
the  wrong  direction.  This  VCB  theory  was  eventually  transcended  to  include 
the  whole  block.    Visual  center  theories,  while  successful  for  some  of  the 
blocks,  when  general  zed  to  all  the  blocks  became  insufficient.  Thus  children 
eventually  determined  that  area  and  weight  were  factors,  made  corrections 
towards  these  factor",  and  finally  understood  that  weight  must  beS^ual  on 
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both  s^des  of  the  balance  point. 

The  Guttman  analysis  demonstrated  that  the  lower  level  theories  were 

necessary^  to  the  construction  of  the  higher  levels.    The  strategies,  although 

related,  were  in  no  way  sufficient  to  produce  success  on  the  clusters.  In 

other  words,  children,  in  attempting  to  balance  the  blocks,  frequently  were 

willing  to  test  out  other  variables  than  the  one  they  believed  to  have  an 

effect.    For  example,  children  with  a  VCB  theory  were  willing  to  test  out  the 

middle  of  the  tfhol*  block  as  a  balance  point.    Those  with  a  UC  theory  were 

willing  to  test  out  the  effect  of  a  shift  towards  the  greater  area;  those 

with  a  belief  that  a  bisection  of  the  area  was  the  correct  point  also  tested 

v 

out  the  effect  pf  weight.    But  until  they  developed  "physical  necessity"  (the 
understanding  that  each  blocK  was  indeed  possible),  they  Aid  not  struggle 
with  the  new  variable  enough  to  be  successful  with  the  cluster.    To  wit, 
while  they  were  wilting  to  test  out  variables  which  contradicted  their 
theory,  until  they  held  fast  to  a  new  theory  they  did  not  struggle  enough  tcv 
he  successful  with  the  cluster  which  tested  that  theory. 

Irool  i  c;it  ions 

Piaget's  notion  of  reflexive  abstraction  suggests  that  learners  need  to 
reflect  on  the  result  of  their  actions  in  relation  to  the  theory  they  hold 
about  balance,  i.e.    contradict iop»  4nd  the  rr^ulting  reflection  bring  the 
learner  to  produce  higher  level  theories.    Although  this  process  seemed 
apparent  in  the  p-     rcols,  t'hore  was  insufficient  data  to  corroborate  such  a 
premise.    Thus  the  **cond  part  of  this  study  was  desgned  to  test  this 
assumption.    It  was  hypothesised  that  egocentric  children  would  benefit  most 
from  a  reflection  on  the  black's  action,  giMen  their  tendency  to  form 
assumptions  about  thi?  role  of  thtir  own  action     According  to  Piaget, 
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coordinating  th*  action  of  the  object  with  the  self's  action  should  result  in 

\ 

;  \ 

the  construction  of  a  general  physical  principle.    Thus  a  re-flection,  via 
video  replay,  on  whether  the  block  balancedior  fell  and  to  which  side  of  the 
fulcrum,  it  fell  should  be  profitable.    Theory  oriented  children,  on  the  other 
hand,  were  expected  to  profit  reore  from  reflection  on  ^he  placements  that 
were  inconsistent  with  their  theory.    For  example,  a  child  who  thinks  the 
block  will  balance  at  point  3,  but  then  sees  via  video  replay  that  it 
actually  balanced  at  point  2,  might  attempt  to  "resolve  this  contradict  ion -and 
thus  construct  a  new  theory. 

Part  II:    Effect  of  Stop-action  Video 
\  Method 

Subjects 

One  hundred  and  twelve  of  the  subjects  tested  in  part  one  of  the  study 
were  classified  as  ego  oriented  or  theory  oriented.    M 1  children  who 
successfully  balanced  at  least  one  cluster  of  blocks  were  assigned  to  the 
Theory  category,  called  theory  because  these  children  at  least  had  a  rule 

that  worked  for  a  subset  of  all  blocKs.    All  children  who  did  0ot  reach 

i 

criterion  on  at  least  one  cluster  of  blocks  were  assigned  to  the  Sao 
category,  called  ego  because  these  children  attended  more  to  thjeir  desire  to 
have  each  block  balance  rather  than 'to  general  principles  about  balance. 
Mater  i  al s 

The  materials  used  were  the  same  as  thos*  in  part  one  of  the  study, 
Pr  ocedur e  ^ 

Subjects  were  randomly  distributed  into  one  of  four  different  treatment 
conditions,  given  four  trailing  sessions,  and  then  posttest*d.    Sex  was  not 
controlled  since  a  previous  analysis  (condition  %  age  x  sex)  had  shown  no 
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significant  difference  (Fosnot,  19S3) . 

A  basic  factorial  design  of  two  orientation  groups  (ego  vs.  theory)  and 
e         four  training  conditions  was  used*    Children  were  pretested  on  the  training 
tasks  in  session  one,  later  given  four  training  sessions,  followed  by  a  - 
posttest  session  on  the  training  task.    Briefly,  in  Treatment  Condition  I, 
called  the  Preo  i c t  Block  condition,  the  child  was  asked  to  predict  what  the 
block  on  the  fulcrum',  stopped  in  aotion  on  the  video  replay,  would  do  when 

i  *  t 

tne  tape  was  reactivated.  In  Treatment  Condition  II,  the  Predict  Placement 
condition,  tfr*  cf  Id  was  asked  to.  predict  the  placement  from  looking  at  the 
replay  of^the  block  stopped  in  mid-air  just  before  placement  on  the  fulcrum. 

In  Treatment  Condition  III,  called  the  Summarize  Replay  condition,  the  child 

J 

saw  the  entire  foatage  from  the  first  grasp  of  the  block  tc  the  end  of  the 
first  clear  release  of  the  block  and  its  subsequent  balance    or  fall.  The 
child  in  Ah  i  s  condition  was  thon  asked  to  summarize  what  he/she  had  just  seen 
in  the  tape  segment.    In  Treatment  Condition  IV,  called  the  Summar i ze  No 
Vi deo  condition,  the  chitxl  was  simply  asked  to  summarize  his/her  most  recent 
attempt  to  balanced  block. 

The  design  tested  the  null  hypotheses  that  the  mears  of  the  pre  to 
posttest  difference  within  each  condition  vould  be  the  same  for  the  Ego  group 
and  that  the  means  within  *ach  condition  for  the  Theory  group  would  be^the 
same.  -No  main  effect  for  condition  was  expected.    A  signif  Scant-' interact  ion 
effect  between  orientation  and  condition  was  expected  with  the  Ego  group 
performing  the  best  in  the  Fredi ct  B1 ock  condition  and  the  Theory  group 
performing  the  best  in  the  Predi ct  PI acement  condition. 

General  di  rect  i  ons..    The  experimenter  designated  the^reen  blocks  and 
said,       would  like  you  to  balance  these  blocks  one  at  a  time  on  here  (points 
to  the  fulcrum).    These  are  helper  blocks  which  you  may  use  to  help  you  if 
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Blocks  were  then  presented  to  the  child  one  at  a  time  by  the  experimenter. 
In  sessions  one  and  three  the  blocks  were  presented  in  a  predetermined  order. 
In  sessions  two  and  four  that  order  was  reversed. 

Predict  block  condition.    The  experimenter  presented  each  block,  one  a* 
a  time,  with  h^nds  on  each  side  of  the  block  so  that  the  bottom  length  of  the 
~b4ock  was  clear.    She  said,  "Try  this  one.*    At  the  presentation  of  blocks 
92,4,5,6,10,11,  and  14  the  experimenter  pressed  the  counter  on  the  video 
recorder^to  zero.    After  the  completion  of  the  episode  (child  attempted  to 
balance  the  block  and  it  balanced  or  fell)  with  each  of  the  aforementioned 
blocks,  the  experimenter  rewound  the  tape  to  zero  and  said,  "Let's  look  at 
you  trying  thac  block  on  television.1    The  tape  was  then  replayed  until  the 
po'nt  where  the  child  placed  the  block  on  th«  fulcrum.    The  experimenter 
stopped  that  action  by  pushing  f&e  recorder  switch  to  pause  and  aske-d,  "What 
is  the  block  going  to  do?"    If  the  child  did  not  r#spond,  the  experimenter 
prcbed  with,  "UiU  it  balance  or  -fall?".   With  a  response  of  fall,  the  child 
was  asKed  to  show  on  the  T.*i.  which  direction  the  block  would  fall.  The 
experimenter  recorded  each  prediction  on  datasheets,  then  said  to  the  child, 
"Let's  see."    The  switch  was  then  p.ushed  to  play  and  the  remainder  of  the 
episode  was  replayed  for  the  child  to  observe  the. correctness  of  the 
prediction.    Blocks  #1,3,6,7,9,12,  and  13  were  presented  to  the  child  for 
balancing  but  no  video  replay  was  given. 

Fredi  ct  placement  condt  tion.    The  s*me  banning  directions  were  given 
as  above.    During  the  replay,  stop-action  occurred  just  before  the  child 
placed  the  block  or.  the  fulcrum.    The  child  was  then  asked  to  predict  the 
placement  of  the  block.    The  experimenter  said,  "Show  me  where  on  the  block 
you  are  going  to  place  it."    If  the  child  did  not  understand  the  question, 
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the  experimenter  said,  "Here,  or  here,  or  here?"  while  moving  her  -finger 
across  the    bottom  of  the    block  from  point  one  to  five.  Predictions  were 
again  written  down.    The  experimenter  said}  "Let's  see."    The  remainder  df 
the  episode  was  then  replayed.  x 

Summarize  replay  condi  tion.    Directions  were  the  same  as  in  conditions  I 
and  II  except  that  the  tape  was  rewound  to  zero  in  the  designated  episodes 
and  repiayed  for  the  chi ld.wi thout  stop-action.    The  experimenter  then  said, 
"Tell  me  what  happened."    Responses  were  written  down.  ' 

No  video  condi  tion.  The  child  vias  presented  each  block  to  balance  as  in 
th*  other  conditions.    After  the  designated  episodes,  the  child  was  simply 
asked,  "Tell  me  what  happened."    Responses  were  written  down  by  the 
experimenter. 

Thus  in  all  conditions  subjects  were  questioned  on  seven  episodes  during 
a  session.    The  length  of  e>ch  episode  was  the  same  across  conditions  since 
the  replay  began  with  the  presentation  of  the  block  and  ended  when  the  child 
f  in  i  shed  wi  th  the  block . 

Pre  and  posttest  directions.  The  child  was  simply  asked  to  try  and 
balance  each  of  the  blocks,  one  at  a  time,  on  the  fulcrum. 
Measures 

The  dependent  variable  was  a  simple  assessment  <pre  to  post  difference) 
of  the  number  of  blocks  successfully  balanced. 

Resul ts 

PI anned  Compar  i  sons 

The  mean  difference  scores  between  pre  and  post tests\  for  each  of  the 
cells  were  calculated  and  planned  comparison  two-tailed  Dunnett  d,  tests  were 
done  to  compare  the  performance  of  the  experimental  groups  with  the  contrdT 
groups.    No  significant  difference  was  found  between  conditions  for  children 
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who  began  with  'an  ego  orientation.    For  children  who  began  with  a  theory 
strong  enough  to  pass  at  least  one  cluster,  this  was  not  the  case.  As 
hypothesized,  a  signi-f  icant'  difference  <p=.05>  was  found  between  the  group 

e 

asked  to  predict  the  placement  of  the  blocks  and  the  group  receiving  no  video 
feedback.    As  can  be  seen  from  Table  1,  showing  the  means  of  the  groups, 
thsor/  children  did  best  in  condition  II,  although  the  difference  was  not 
statistically  significant  with  groups  o+her  thanothe  no  video  feedback  group. 
A  closer  leok  at  which  blocks  were  successfully  balanced  produced  some 

•s 

further  insights.    When  grouped  by  clusters,  thereby  eliminating  luck  as  a 
possible  factor,    condition  II  produced    more  success  than  every  other 
condition  for  the  Theory  group  <p=.05)  See  Table  2. 
Analyst  s  of  Uar  iance 

An  anal/sis  of  variance  with  the  regression  approach  for  unequal  N's  was 
performed.    Age  was  covaried.    No  main  effect  was  found  tor  the  variables 
Orientation  <F=*.89.  p».35)  or  Condition  <F=*1.34,  p-.27>.  A  significant 
(F-2.6,  p=.05)  two-way  interaction  between  Orientation  and  Treatment 
Condi t i onwas  found.    Post  hoc  Bonferroni  t,  tests  showed  the  interaction  to 
be  significant  at  .05  between  the  orientation  groups  in  condition  II.  While 
this  was  the  most  successful  training  condition  for  *he  Theory  group,  it  was 
the  least  successful  for  the  Ego  group. 

Discussion 

The  data  showed  conclusively  that  for  children  who  have  already  begun  to 
think  about  a  general  means  of  balance,  rather  than  what  they  themselves  do 
in  a  specific  instance,  stop-action  video  improves  performance  if  the  stop- 
action  orients  the  child  to  where  'ie/she  is  about  to  place  the  block.  This 
was  seen  in  the  Theory  category  o<  children  in  the  Predict  Placement 
condition.    With  this  type  of  video  feedback  the  children  had  to  reflect  on 
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their  reasons  for  each  placement.    Having  to  predict  the  placemen*  j^jst  prior 
to  the  continuation  of  the  feedback  tape,  combined  with  the  feedback  of  ^the 
consequent  success  or  failure,  helped  to  bring  the  whole  episode  into  an 
integrated  system  of  means-end  relations.    Straight  replay  was  not  as  potent 
a  training  condition,  nor  was  reflection  on  the  action  of  the  block, 
suggesting  that  assumptions  cannot  be  made  about  the  content  of  the  child's 
reflection.    Repeated  exposure  is  not  necessarily  constructive. 

Ego  children,  while  being  younger  than  the  Theory  group,  were  also 
characteristically  different  in  their  approach  to  the  training  task. 
Response  protocols  indicated  that  these  children  were  more  often  the  children 
who  made  only  brief  adjustments  with  a  block  if  it  did  not  balance.  They 
were  more  lively  to  attribute  a  failure  to  a  "b«>d  block*  than  to  their  own 
placement  strategy.    They  were  frequently  children  who  explored  the  physical 
attributes  of  each  block  independent  of  hew  those  attributes  related  to  the 
balancing  task,  \ 

Children  in  the  Theory  group  understood,  at  least  in  part,  that  there 
was  some  rule  that  could  be  applied  to  several  blocks,  if  not  all  blocks, 
that  could  be  discovered  if  one  thought  clearly  about  several  blocks  at  a 
time.    These  children  would  make  spontaneous  comments  such  as,  "Hey,  this  one 
is  not..\jke  the  other  one.4    This  was  most  prevalent  when  two  blocks  looked 
alike  but  were  weighted  differently.    Thus  it  is  reasonable  to  conclude  that 
children  in  the  Theory  group  during  training  reflected  more  on  the  means  to 
establish  balance.    The  rules  they  constructed  were  the  result  of  reflecting 
or  ni**ns-end  relations.  The  reflection  facilitated  by  Condition  I,  Predict 
Bl ock ,  is  not  as  appropria        match  to  the  theory-or i ented  chila's 
assinilatory  schemes.    The  focus  of  this  reflection  is  not  means  or  theory 
oriented,  but  simply  object/action  oriented.    The  theory-oriented  child  is 
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not  thinking  about  "what11  happens,  but  "why"  it  happens.  Evidently 
re-flection  on  the  success  and  failure  of  the  block,  without  relating  the 
means  by  which  that  success/failure  occurred,  has  no  positive  effects  for 
problem  solving  in  these  situations. 

Although  the  hypothesis  about  the  advantage  of  the  Predict  Block 
condition  for  the  ego-oriented  children  was  not  supported,  there  was  a  trend 
for  this  group  to  do  better  in  Condition  1  than  in  the  other  conditions.  It 
is  possible  that  had  training  been  longer  than  four  sessions,  a  significant 
difference  may  have  been  found  between  conditions  for  the  Ego  children. 
Perhaps  Condition  I  did  facilitate  a  decentration  from  one's  own  actions  to 
the  action  of  the  block  more  than  tire  other  conditions,  bdt  the  step  from  an 
ego  orientation  to  the  first  theory  is  a  big  one,  requiring  more  time  than 
going  from  a  VC  theory  to  an  AC  theory. 

The  reasons  for  the  lack  of  success  of  Ego  children  in  Condition  II  were 
obvious  during  the  data  collection.    First,  because  they  had  no  theory  about 
a  necessary  placement,  the  question  ascertaining  placement  made  no  sense  to 
them  and  thus  probably  served  as  a  distractor.    Many  Ego  children  during 
training  were  observed  (in  response  to  the  placement  question)  tracing  a 
vertical  line  on  the  monitor  from  the  fulcrum  to  the  point  on  th*  block 
directly  above  the  fulcrum.    In  other  words  their  responses  were  based  on 
proximal  causes  rather  than  any  theory  about  a  ■correct*  placement.  Other 
Ego  children  were  just  simply  confused  by  the  question  and  appeared  to  be 
guessing  randomly, 

4 

Secondly,  this  condition  for  Ego  children  might  have  served  as  a 
negative  reinforcer.    For  Ego  children,  the  question,  "Show  me  the  spot  on 
the  block  where  you  are  £oing  to  put  it*  might  .have  been  interpreted  frith  an 
emphasis  on  the  •you".    Thus  the  ensuing  action  of  the  block  falling  becomes 
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a  criticism  of  their  placement.    In  contrast,  Theory  children  might  have 
emphasized  the  placement  question  in  relation  to  a  theory  about  balance, 
rather  than  themselves,  thus  the  ensuing  action  of  the  block  becomes  feedback 
to  confirm  or  disc  on -firm  that  theory. 

Concl usi ons  and  Impl  icat ions  -for  Further  Research 

This  study  is  evidence  that,  while  reflection  in  general  can  be 
conducive  to  the  development  of  higher  understanding,  when  reflection  is  in 
relation  to  the  learner's  own  question  and  focuses  on  contradictions  it  is 
more  powerful.    Such  a  conceptual  understanding  of  reflection  is  in  concert 
with  the  notions  of  learning  as  a  constructed,  self-regulated  process.  In 
the  process  of  problem  solving,  the  learner  has  expectations  and  hypotheses 
which  he/she  is  testing,  dependent  on  his/her  stage  of  development. 
Reflection  on  the  result  of  actions  related  to  these  hypotheses  is  more 
conducive  to  learning  than  simply  reflecting  on  the  whole  episode. 
Assumptions  cannot  be  made  that  because  replay  is  provided  the  learner  is 
necessarily  focusing  on  the  relevant  aspects  of  the  episode. 

This  study  also  serves  as  an  illustration  0/  how  current  technology  can 
be  used  to  study  cognition.  The  use  of  video  in  par#bne  of  this  study 
allowed  for  a  naturalistic  filming  of  the  self-regulated  behavior  of  the 
children  as  they  attempted  to  balance  the  blocks.  All  adjustments,  pauses, 
corrections,  and  apparent  testing  of  variables  could  be  captured  on  film  and 
then  analyzed  later.    These  data  then  led  to  hypotheses  about  developmental 
differences  in  orientation  to  the  task  which  were  consequently  tested  in  part 
two  of  the  study. 

While  video  technology  was  sufficient  in  this  experiment  in  recording 
behavior,  the  analysis  still  had  some  subjectivity  due  to  human  raters  making 
judgements  while  viewing  -the  tapes,    Although  interater  reliability  was  high, 
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current  computer  technology  could  alleviate  an/  subjectivity,    If  subjects 
attempted  to  solve  a  similar  simulated  physic?  task  on  a  monitor,  the 
computer  could  record  all  adjustments  made  and  then  determine  the  variables  . 
the  subjects  were  apparently  testing. 

Computer  programming  also  structures  information  into  a  theory  testing 
paradigm.    If  a  child  is  asked  to  write  a  program  to  simulate  the  physics  of 
a  task,  he/she  must  construct  a  rule  or  formula  to  explain  the  phenomenon. 
When  the  program  is  run,  if  it  does  not  work  it  must  be  "debugged*  or 
analyzed  for  errors.    This  process  is  analogous  to  theory  testing,  a  process 
demonstrated  by  the  video  study  to  be  conducive  to  learning. 

The  following  study  has  been  designed  as  an  extension  of  the  video  study 
using  computer  technology.  Ninety-six  t->  s  and  girls  between  the  ages  of  8 
and  10  years  will  be  asked  to  balance  the  blocks  used  in  the  video  study. 
Two  groups  will  be  asked  to  do<this  task  via  a  computer  simulation  (see 
Figure  2);  a  third  group  will  serve  as  a  control  and  will  have  direct 
experience  with  wooden  blocks  on  a  fulcrum.    The  computer  groups  will  differ 
in  that  one  group  will  have  training  in  programming  the  blocks  to  balance 
while  the  other  group/ wi 1 1  simply  attempt  to  balance  e^ch  block  by  directly 
moving  the  computer  graphic.    It  is ^hypothesized  that  the  group  programming 
the  blocks  to  balance,  since  programming  requires  the  generating  and  testing 
of  a  theory,  will  progress  further  in  an  understanding  of  the  physics 
involved  than  the  groups  having  only  graphic  simulation  or  di rect^physi cal 
exper  i  ence .  ■ 

This  study  should  allow  educators  to  capitalize  on  the  more  unique 
features  of  computer  technology  in  ways  that  ultimately  give  students  more 
autonomy  in  evaluating  their  own  theories  about  the  scientific  principles 
involved  in  physical  knowledge .    More  importantly,  it  allows  the  researcher 
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to  be  a  more  efficient,  scientific  theory  tester,  of  theory-testing  behavior. 
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FIGURE  1 


Balance  task  blocks.    Blocks  drawn  to  a  1:6  scale.    Drawings  arranged  into  5  clusters. 
cluster  1  cluster  2  cluster  3  cluster  4  cluster  5 


visually  symmetrical  blocks 


conspicuously 
weighted  blocks 


inconspicuously  impossible 
weighted  blocks  blocks* 


fa 
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A 


A    designates  balance  point 
L     designates  lead 

*  These  blocks  can  be  balanced  with  the  use  of  helper  blocks  as  counterweights 


Helper  Blocks* 


190 


BBT  COPY  MULAIlE 


•  J 

FIGURE  2 

Computer  Simulat  ions  of  Blocks  in  Figure  1 


A     designates  balance  point  (turtle  placement) 
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TABLE  X 


CHA       IN  NUMBER  OF  BLOCKS  SUCCESSFULLY  BALANCED 
BY  xREATMENT  CONDITION  AND  PRETEST  ABILITY 


Treatment  Condition 


Pretest  Ability 


Block 
I 


Placement 
II 


Replay 
II 


No  Video 
IV 


Ego: 

x  pre  test  score 
x   post  test  score 

mean  change 

Theory: 

x  pre  test  score 
x    post  test  score 

mean  change 


1.8(1.5)* 
3. 3(2. A) 

1.5 


6.7(3.4) 
8.7(4.0) 

1.94 


2.5(2.1) 
2.6(3.1) 

.1 


7.1(2.9) 
10.8(3.3) 

3.76 


2.1(1.4) 
2.9(3.1) 

.82 


6.4(2.7) 
8.1(4.2) 

1.71 


2.2(1.3) 
3.3(1.3) 

1.17 


7.8(3.7) 
8.5(4.6) 

.71 


♦Standard  deviations  are  in  parentheses. 
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TABLE  z 

CHANGE  IN  NUMBER  OF  CLUSTERS  SUCCESSFULLY  PASSED 
BY  TREATMENT  CONDITION  AND  PRETESt  ABILITY 


Treatment  Condition 


Pretest  Ability 


Block 
I 


Ego: 

x  pre  test  score  0(0}* 
x   post  test  score       .6 (.8) 

mean  change  .6 

Theory: 


Placement 
II 


0(0) 
4(1) 

.4 


x   pre  test  score       2.01(1.1)  1.9(1) 
x   post  test  score     2.6(1.7)  3.5(1.3) 
mean  change  .6  1.6 


Replay 
III 


No  Video 
IV 


0(0)  0(0) 
.5(1)  .5(.9) 

.5  .5 


1.7(1)  2.3(1.2) 
2.2(1.6)  2.7(1.8) 
.5  .4 


* standard  deviations  are  ip  parentheses. 
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DEFINING  ATTRIBUTES  OF  ANALYTIC  ABILITY  AS  A  PREREQUISITE  FOR 
SELECTION  OF  INSTRUCTIONAL  STRATEGIES 


Margaret  (Meg.)  French.  Ph.D 

Advanced  Science  &  Technology  Associates/Southern  California 
Edison  Co. 


INTRODUCTION 

This  study  supports  the  view  that  the  degree  of  differen- 
tiation exhibited  by  field- independent  and  field -dependent 
learners  will-  affect  analytic  strategies  used  to  process 
visual  information.    The  purpose  of  this  study  was  to  explore 
the  defining  attributes  of  analytic  ability  as  they  relate  to 
theoretical  cognitive  styles  originally  described  by  both 
Witkin,  Dyk,  Faterson,  Goodenough  and  Karp,  (1962)  and  Kagan, 
Moss  &  Sigel,  (1963). 

RATIONALE 

Technical  and  vocational  training  relies  heavily  on  the  use 
of  visuals.    The  instructional  designer  is  faced  with  a 
recurrent  question  of  how  to  design  visuals  which  facilitate 
effective,  efficient  processing  of  information.  Often 
technical  line  -  drawings  are  required,  which  demand 
analytic  skills  in  perceptual  and  cognitive  restructuring 
(Cf.  Witkin,  Moore,  Goodenough  &  Assoc.,  1977). 

When  learners  are  to  perform  a  concept  attainment  task,  they 
are  required  to  use  a  stylistic  capacity  to  break  down  the 
line  -  drawing  into  its  component  parts  (in  an  analytical 
manner)  as  a  prerequisite  for  processing  the  concept 
information  (Witkin,  Moore,  Goodenough  &  Cox,  1977). 
Field- independent  learners  have  demonstrated  more  effective 
strategies  in  tasks  which  demand  analytic  skills  in 
perceptual  and  cognitive  restructuring,  whereas  the  field- 
dependent  learner: 

...is  likely  to  have  difficulty  with  that  class  of 
problems,  where  the  solution  depends  on  taking  some 
critical  element  out  of  the  context  in  which  it  is 
presented  and  restructuring  the  problem  material  so 
that  the  item  is  now  used  in  a  different  context. 
(Witkin  and  Goodenough,  1977,  p. 8). 

Kagan,  Moss  and  Sigel  (1963)  have  also  identified  a  strategy 
of  information  processing  which  they  described  in  terms  of  a 
tendency  to  analyse  stimuli  into  differentiated  parts,  as 
opposed  to  a  non-differentiated,  global  acceptance  of  the 
entire  stimulus. 
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The  common  use  of  the-  terms  analytic  and  non*»analytic  by 
both  Witkin  (Witkin,  Dyk,  Faterson,  Goodenough*  and  Karp, 
1962)  and  Kagan  (Kagan,  Moss  and  Sigel,  1963)  has  tempted 
several  researchers  to  suggest  that  the  field-dependence- 
independence  notion  of  Witkin,  and  the  dimension  studies  by 
Kagan,  may  relate  to  the  same  ability  (Doyle  1965,  Messick 
and  Fritzk7  1*63,  Stanes  and  Gordon  1973,  Wacbtel  1968). 
Cronback  and  Snow  (1977)  have  noted  that  the  constructs  of 
Kagan  and  Witkin  appear  to  be  conceptually  related. 

Accurate  codification  of  the  analytic  term  may  be  crucial  in 
some  aspects  of  cognitive  style  research.    According  to 
Wallach  (1962),  the  essential  task  for  those  conducting 
research  on  cognitive  style  is  to  ascertain  each  style* s 
defining  attributes.    Knowledge  of  these  stylistic  attributes 
will  guide  the  investigator  in  a  search  for  other  "mani- 
festations of  the  'same*  style*  (Wallach,  1962,  p.  199). 
Furthermore,  increased  knowledge  of  relevant  stylistic 
attributes  and  learner  processing  capacities  may  aid  in  the 
specification  of  effective  instructional  design  strategies 
for  concept  attainment  tasks?.    Ausburn  and  Ausburn  (1978) 
have  pointed  out  that  knowledge  of  stylistic  attributes  is 
necessary  a  prerequisite  for  selection  of  instructional 
design  strategies  which  consider  the  processing  demands  of 
the  learning  task.    The  need  for  consideration  of  processing 
demands  has  beea  highlighted  by  research  which  has  shown  that 
individuals  are  likely  to  favor  and  do  better  in  tasks  in 
which  they  are  suited  by  their  cognitive  style  (Cronbach  and 
Snow  19f77,  Witkin  and  Goodenough,  1977). 

The  rationale  for  this  study  is  based  on  the  following 
assumptions: 

.>       the  better  a  visual  is  perceived,  the  better  it  can  be 
encoded,  remember  and  utilized. 

o       a  learner's  ability  to  implement' effective  processing 
strategies  is  influenced  by  task  demands,  media 
attributes  and  learner  aptitude. 

o       learning  will  be  most  effective  when  task  demands  and 
media  attributes  either  precisely  complement  the 
processing  aptitude  of  the  learner,  or  adapt  to  the 
learner's  aptitude. 

• 

o       increased  knowledge  of  the  stylistic  attributes  of 

analytic  ability  may  aid  in  the  design  of  instructional 
visual  for  concept  attainment  tasks. 
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DISCUSSION 


This  study  defined  the  cognitive  style,  field-dependence- 
independence  as  reflecting  an  analytic  ability  termed  fluid 
intelligence  (cf.  Cattel,  1971;  Cronbach  and  Snow,  1977: 
Snow  and  Peterson,  1980  H    According  to  Horn  (1976),  fluid 
inte"tgenc.c  is  aieasured  in  tests  of  reasoning  which  employ 
figural  and  non-word  symbols:    that  is  non-verbal  intel- 
ligence tests.    In  theory,  field-dependence- independence 
-S-.00?8!?^  to       one  expression  of  a  more  general 
indi>mfdual  difference  dimension,  defined  at  one  extreme  by  a 
global  mode  of  processing  and  at  the  other  extreme  by  a  more 
differentiated,  analytical  manner  of  processing  (Witkin, 
%  Faterson,  Goodenough  and  Karp,  1962,  1974).    In  people 
with  a  relatively  analytic  cognitive  style,  experiences  can 
be  analysed*  and  if  necessary,  restructured  through  the  use 
of  internal  referents.    By  contrast,  in  people  with  a 
relatively  global  cognitive  style,  experiences  are  governed 
<L  fRf"**!  5ef«r«nts  and  dominant  organization  of  the  field 
(Witkin  and  Goodenough,  1977).    A  central  hypothesis  in 
field-dependence-independence  theory  is  that  individual 
differences  in  expressions  of  articulated  or  differentiated 
functioning  in  one  area  are  related  to  expressions  in  other 
areas.    A  considerable  body  of  evidence  supports  this 
hypothesis  (Witkin,  Goodenough  and  Oltman,  1977).    Thus,  the 
more  differentiated  mode  of  the  field- independent  person  is 
evidenced  in  a  more  active  approach  towards  analysis  and 

?ErucJuring  in  001:11  Perceptual  and  intellectual  activities. 
GJfebal  cognitive  functioning,  on  the  other  hand f  is 
represented  by  a  more  passive  manner  of  dealing  with  the 
field,  accepting  it  as  presented  with  limited  analytical  and 
structuring  abilities  in  both  perceptual  and  intellectual 
activities  (Witkin  and  Goodenough,  1977). 

In  the  typical  concept-attainment  problem    stimuli  composed 
of  a  number  of  attributes  are  used.    It  h**  been  suggested 
that  problems  of  this  sort  may  require  perceptual  and  in- 
tellectual analysis  of  the  stimulus  complex  into  its  relevant 
attribute  /components,  a  requirement  that  is  more  easily 
attained  by  field- independent  learners  (Dickstein,  1968).  In 
this  view,  field-dependent  subjects  are  dominated  by  the 
salient  (that  is,  most  noticeable)  attributes  of  the 
stimulus,  which  may  achieve  a  figural  quality  against  the 
ground  provided  by  other  aspects  of  the  stimulus  con- 
figurations.   When  directed  to  construct  hypotheses  about 
the  concept  definition,  these  learners  respond  to  the 
salient,  external  referents  rather  than  sampling  broadly 
from  the  set  of  available  stimulus  attributes,  as  field- 

}2^Spe2?ent  indi^J??als  are  likely  to  do  (Sirschenbaum, 
1968;  Shapson,  1973)^ 
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This  emphasis  on  strategies  used  by  learners  supports  * 
Cronbach  and  Snow's  contention  (1977)  that  the  study  of 
cognitive  style  should  involve  individual  differences  in 
rocess  rather  than  content  variables;  that  is, 
nvestigators  should  be  more  interested  in  individual 
differences  in  modes  of  processing  information.  Research 
has  shown  Jthat  individuals  are  likely  to  favor  and  do  better 
in  tasks  in  which  they  are  suited  by  their  cognitive  style  • 
(Vitkin  and  Goodenough,  1977).    Field- independent  people 
have  demonstrated  more  effective  strategies  in  concept 
learning  tasks  which  demand  analytic  skills  in  perceptual 
and  cognitive  restructuring  (Vitkin  &  Goodenough,  1977). 

Kagan, -Moss  and  Sigel  (1963)  have  also  identified  a  strategy 
*  of  information  processing  which  they  describe  in  terms  of  a 
tendency  to  analyse  stimuli  into  differentiated  parts,  as 
opposed  to  a  undifferentiated,  global  acceptance  of  the 
entire  stimulus.    Kagan  et  al.  noted  the  similarity  of  this 
dimension  to  the  field-dependence- independence  dimension 
studied  by  Vitkin,  Dyk,  Faterson,  Goodenough  and  Karp 
(1962).    In  reply,  Vitkin  (1963)  cautioned  that  despite" many 
apparent  similarities,  there  was  still  considerable  question 
as  to  how  closely  the  two  concepts  were  related. 

Attempts  to  investigate  empirically  the  relation  between  the 
dimensions  studied  by  Kagan  and  by  Vitkin  were  made  by 
Messick  and  Fritzky  (1963)  and  Vachtel  (1968).    Vachtel  felt 
that  if  a  relationship  did  exist  between  » J. eld- dependence - 
independence  (Vitkin* s  concept)  and  analytic  attitude 
(Kagan 's  concept),  it  may  be  highlighted  if  extreme  groups 
were  studied  and  compared.    Consequently,  subjects  for  his 
study  were  preselected  on  the  basis  of  their  Embedded  Figures 
Test  performance,  and  then  these  extreme  groups  of 
field-dependents  and  field- independents  were  compared  on  a  a 
measure  of  analytic  attitude.    He  utilized  a  visual  analytic 
attitude  task  developed  for  use  with  adults  by  Messick  & 
Fritzky  (1963).    The  task  was  modelled  on  one  us>  d  by  Kagan 
in  his  research  with  children.    This  test  of  analytic 
attitude  was  based  on  the  following  percept: 

An  analytic  child  presumably  differentiates  complex 
arrays  to  a  greater  degree  than  a  non-analytic  child. 
That  is,  he  applies  labels  to  the  whole  stimulus  as 
well  as  to  the  parts.    He  reacts  to  a  different 
immediate  environment,  if  the  environment  is  defined, 
in  part,  as  that  sector  of  the  stimulus  field  that  ts 
labelled.    One  method  of  testing  this  hypothesis  is  to 
require  the  individual  to  learn  a  response  to  a  complex 
stimulus  and  to  assess  subsequently  the  degree  to  which 
the  response  is  transferred  to  discrete  parts  of  the 
original  stimulus.     (Kagan,  Moss  and  Sigel,  1963,  p. 94) 
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Kagan's.aim  in  developing  this  test  was"  to  assess  its 
relationship    to  the  conceptual  styles  or  strategies  used  by 
individuals  in  concept  formation  tasks.    He  illustrated  that 
children  who  scored  as  being  "analytic"  on  the  visual, 
analytic  attitude  test  also  tended  to  use  a  more  active, 
analytical  strategy  in  forming  conceptual  grouping,  whereas 
children  who  scored  towards  the  "global"  end  of  the 
dimension  on  the  analytic  attitude  test  tended  to  use  a  more 
passive  conceptual  strategy,  based  on  a  global  acceotance  of 
the  entire  stimulus.    Wachtel  (1968)  also  related  the  visual 
Test  of  Analytic  Attitude  to  a  conceptual  style  task. 
However,  a  more  significant  outcome  of  his  study  was  to 
point  out  a  very  strong  relationship  between  Embedded  Figures 
Test  performance  and  scores  on  the  Test  of  Analytic  Attitu^eT 

Kesults  should  not  be  interpreted  to  mean  that  the  two  ~  

approaches  measured  exactly  the  same  dimension. 

Boflf,f?gan  et  «}•  <1963)  and  Witkin  (1963), stressed  the 
multidimensional  nature  of  their  view  of  strategies  used  by 
individuals.    Messick  and  Fritzky  (1963)  reflected  that 
conceptually  Kagan's  test  measured  a  tendency  to  experience 
items  as  discrete  components  of  a  visual  field.  Witkin, 
Kyk,  Faterson,  Goodenough  and  Karp  (1962)  have  described 
field-dependence- independence  not  only  as  a  tendency  to 
experience  items  as  discrete  from  their  backgrounds,  but 
also  as  ability  to  overcome  the  influence  of  an  embedding 
context.    The  importance  of  the  relationship  of  the  two 
approaches  appears  to  lie  in  their  unique  interaction  in 
tasks  that  require  analytic  skills,  since  the  overcoming  of 
embedding  influences  would  seem  to  be  facilitated  by  & 
tendency  to  experience  items  as  separate  from  their  contexts 
and  vice  versa  (Messick  and  Fritzky,  1963). 

Accurate  codification  of  the  analytic  term  may  be  crucial  in 
some  aspects  of  cognitive  style  research.    According  to 
Wallach  (1962),  the  essential  task  for  those  conducting 
research  on  cognitive  style  is  to  ascertain  each  style's 
ddfining^attributes.    Knowledge  of  these  stylistic  attributes 
will  guide  the  investigator  in  a  search  for  other  "manifest- 
ations of  this  'same1  style"  (Wallach,  1962,  p.  199). 

Research  on  Witkin 's  articulated-global  dimension  has  raised 
the  possibility  that  "analytic"  or  "articulated"  functioning 
in  his  terms  may  consist  of  two  separate  but  related 
factors:    (a)  reliance  on  internal  (bodily >  or  external 
(visual)  referents,  as  well  as  (b)  greater  or  lesser 
competence  in  cognitive  restructuring  (Witkin  and 
Goodenough,  1977).    Furthermore,  Witkin,  Goodenough  and 
Oltman  (1977)  have  defined  field-dependence- independence  as 
"extent  of  autonomous  functioning,"  (p.  24)  with  field- 
independent  people  demonstrating  more  autonomous, 
differentiated  functioning  through  the  use  of  internal 
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referents,  and  field-dependent  individuals  tending  to  prefer 
the  use  of  external,  visual  referents  in  their  global,  less 
differentiated  and  less  autonomous  approach.  Traditionally, 
field-dependence- independence  has  been  associated  with  tests 
of  embeddedness ,  for  example,  Group  Embedded  Figures'  Test 
(Witkin,  Oltman,  Raskin  and  Karpi  1971).    in  Witkin 's  recent 
differentiation  model,  embeddedness  tests  were  specified  as 
examples  of  cognitive  restructuring  tasks  (Vitkin,  Goodenough 
and  Oltman,  1977).    In  summary,  Wit  kin's  current  view  of  the 
analytic-global  dimension,  is  4e fined  by  two  factors  relating 
to  disembedding  and  to  autonomy  which  are  evidenced  in  that 
.   reflect  a  state  behaviors  of  relatively  greater  or  less 
differentiation  (Vitkin,  Goodenough  and  Oltman,  1977).  By 
implication,  performance  on  tasks  which  require  analytic 
structuring,  for  example,  concept  acquisition  tasks  and 
Regan's  visual  analysis  task  (that  is,  Test  of  Analytic 
Attitude),  may  also  reflect  the  individual's  state  of  dif- 
ferentiation.   As  field- independent  cognitive  style  has  &een 
associated  with  more  differentiated  functioning,  high 
performance  on  analytic  structuring  tasks  may  be  related  to 
ability  to  structure  experience  into  discrete  parts,  as  well 
as  capacity  to  disembed  relevant  details  and  restructure 
information  as  required.    As  fieldodependent  cognitive  style 
has  been  associated  with  less  differentiated  functioning, 
low  performance  performance  on  analytic  structuring  tasks  may 
be  related  to  lack  of  ability  to  structure  experience  into 
discrete  parts  as  well  as  less  capacity  to  dissembled 
relevant  details  and  restructure  information  as  required. 

METHOD: 

For  convenience  in  data  collection,  it  was  decided  to  use  the 
Group  Embedded  Figures  Test  (Witkin,  Oltman,  Raskin  and 
Karp,  1971),  as  a  measure  of  field-dependent- independent 
aptitude.    Only  students  designated  as  extremely  field- 
dependent  or  extremely  field- independent  by  their  Group 
EmbeddedFigures  Test  (GEFT)  score  were  included  in  the 
study: Scores  were  analysed  with  the  upper  and  lower  26%  of 
scores  determined  to  represent  the  extremes  of  field- 
independent  and  field-dependent  subjects  respectively.  This 
technique  followed  statistical  procedures  of  Kelly  (1939), 
Greco  and  McCluhg  (1979)  and  McClung  (1975).    Cronbach  and 
Snow  (1977)  have  recommended  the  use  of  high  and  low  extreme 
groups  by  pointing  out  that  such  a  design  is  appreciably 
more  powerful  than  a  study  with  the  same  sample  population 
distributed  over  the  full  aptitude  range. 

This  study  sought  to  compare  scores  on  the  GEFT  with  scores 
on  an  adaptation, of  Regan* s  visual  analysis  task,  that  is, 
the  Test  of  Analytic  Attitude  (Nessick,  1962).    Messick  and 
Fritxxy  U9o3).  and  Vachtel  (1968)  have  utilized  this  adap- 
tation for  adults  of  the  visual  analysis  task  developed 
by  Kagan,  Moss  and  Sigel  (1963).    The  adult  version  of  the 
task  first  requires  each  subject  to  learn  nonsense  syllable 
labels  for  a  series  of  complex,  geometric  designs.  Next, 
the  subjects  are  asked  to  supply  the  appropriate  design 
label  for  a  single  aspect  (part)  of  the  preveiously- learned 
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design.    For  example,  the  subject  night  be  shown  only  the  * 
background  pattern  from  the  original  design  or  just  isolated 
eie5enJ8  *xcm  the  orifflaal  design.    In  other  words,  the  Test* 
of  Analytic  Attitude  measures  each  subject's  capacity  to 
identify  part  aspects,  termed  design, variations ,  from 
previously^arned  designs.   

Dependent  variable's  consisted  of  seven  different  scores  on 
the  analytic  attitude  task.    The  first,  termed  ORIG,  refers 
to  the  measure  of  the  subjects*  ability  to  memorise  the  six 
original,  complete  designs  together  with  their  nonsense 
syllable  labels.    The  ORIG  score*  refers  to  the  number  of 
original  designs  correctly  identified  before  presentation  of 
the  design  variations.    Hie  remaining  six  dependent  variables 
refer  to  the  six  types  of  variations  of  the  original  designs 
that  were  utilized  in  the  test  of  analytic  attitude.  An 
example  of  an  original  design  and  its  six  variations  are 
illustrated  in  Figure  1.  n 

These  variations  are  of  the  following  types: 

Variation  1       The  original  figure  composed  of  the  original 

elements,  with  no  background  (denoted  ef-,*  for 
"element,  figural  form,  no  background). 

Variation  2       Original  background  only  («-b). 

Variation  3       The  original  element  uniformly  spaced  against 

the  original  background,  with  no  figural  form 
(e-b). 

Variation  A       The  original  element  uniformly  spaced  with  no 

background  and  no  figural  form  (e— ).  , 

Variation  5       The  original  figural  forth  represented  by 

means  of  a  new  and  different  element,  with  no 
background  ( -f- ) . 

Variation  6       The  original  figure  indicated  by  enclosing 

lines  against  the  original  background,  with  no 
element  (-fb-) . 

This  test  of  analytic  attitude  was  composed  of  two  sections. 
The  first  section  was  called  "Memory  for  Designs"  (Orig.)  by 
Messick  and  Fritzky  (1963).    In  the  present  study,  this 
section  was  termed  "ORIG' .    This  first  test  section  required 
each  subject  to  learn  six,  original  designs  so  that  they 
could  be  recognized  by  name.    Each  subject  was  given  a  page 
containing  six  complex,  geometric  designs*  under  each  of 
which  was  printed  a  nonsense- syllable  label.    Each  original 
design  consisted  of  a  figural  form,  made  up  of  discrete 
elements,  and  a  background  pattern.    After  the  defined  time 
limit,  this  page  was  replaced  by  a  second  page  which  pre- 
sented the  six  designs  again,  but  in  a  different  order  and 
without  their  labels.    Subjects  were  asked  to  supply  the 
appropriate  nonsense  syllable  label  for  each  design. 
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Figura  1  t   ExaaplM  of  an  original  dasiga  "via" 

*nd  its  six  variationa.  (Adapted  from 
a  Mtasoro  of  Analytic  attituda  d«vis«d 
by  8.  MtMieJc,  1962.) 
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After  a  short  period,  this  test  page  was  replaced  by  a  second 
4  section  of  the  task.    Hessick  and  Fritzky  called  this  second, 
•  section  "Identifying  Variations".    The  second  section 
consisted  of  a  booklet  containing  thirty-six  designs;  that 
is,  six  variations  of  each  of  the  original  six  complex 
designs.    These  variations  consisted  of  either  the  background 
,  pattern,  the  original  figural  form  6r  shape  without  the 
elements,  the  original  elements  alone,  or  some  combination 
thereof.    The  subjects  were,  required  to  supply  th.e  appro- 
priate label  for  each  variation  based  on  their  learning  of 
the  six  original*  complex  designs     It  should  be  noted"  that 
the  six  nonsense  labels  were^boldly  printed  across  the  bottom 
ot  All  pages  in  both  Section  1  and  II  of  this  task.  Thus, 
subjects  were  not L require  to  hold  the  actual,  verbal  labels 
in  memory.    A  sample  page  from  the  test  booklet's  shown  in 
Figure  2. 

•  -  * 

In  summary,  this  study  sought  to  determine  whether  a 
relationship  existed  between  the  scores  for  the  six  design 
variations  and  extreme  scores  on  the  field-dependence- 
.  independence  dimension  as  measured  by  the  Group  Embedded  • 
Figures  Tebt  (Witkin,  Oltman,  Raskin  and  Karp,  1971).  Three 
types  of  scores  were  compared  with  field-dependence- 
independence  scores: 

1.  the  six  "variations"  scores 

2.  a  total  score  for  the  six  variation  scores  combined 

3.  a  memory  score  (ORIG)  for  the  original  six  designs -and 
their  nonsense  syllable  labels. 

Of  a  sample  of  492  males  aged  from  16*21  years,  113  were 
determined  to  score  within  the  extreme  field-dependent 
range,  and  106  were  designated  as  having  extreme 
field- independent  cognitive  style. 

An  Overview  ofData  Analysis 

A  one-way  analysis  of  covariance  was  used  to  analyse  data. 
The  score  for  the  number  of  correctly  identified  original 
designs;  that  is,  the  original  memory  score  (ORIG),  was 
utilized  as  the  covariate.    The  ORIG  variable  was  inserted 
into  the  design  to  control  and  remove  extraneous  variation, 
from  the  remaining  seven  dependent  variables;  that  is,  the 
six  individual  variations  scores  plus  the  composite  score. 
Field-dependeht- independent  aptitude  was  the Categorical 
independent  variable  of  primary  interest  to  the  analysis.  To 
determine  the  effect  of  this  factor  on  test  scores, 
regression  procedures  were  used  to  remove  variation  in  each 
dependent  variable  due  to  the  covariate  (ORIG). 
Conventional  analysis  of  variance  then  was  performed  on  the 
"Corrected"  scores.    Where  analysis  revealed  significant 
differences,  visual  inspection  of  the  two  relevant  aptitude 
means  indicated  the  nature  of  the  difference. 
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Supplementary  analyses  were  conducted  to  aid  in  the 
interpretation  of  results.    These  analyses  included: 

1.  Measures  of  the  sensitivity  of  the  design.  Deter- 
minations of  appropriate  sample  size  and  power  were 
conducted  using  procedures  given  by  Cohen  (1969)  and 
Keppel  (1973). 

2.  Estimates  of  treatment  magnitude  (Omega  squared). 
•These  estimates  were  constructed  using  procedures  given 
by  Keppel  (1973,  1982)  and  Kirk  (1968). 

3.  Tests  for  homogeneity  of  variance  for  all  measures. 
These  tests  were  conducted  using  procedures  given  by 
Kirk  (1968)  and  Winer  (1971). 

Estimates  of  reliability  (rtt)\  The  Kuder-Richardson 
(K-R)  formula  21  was  used  to  estimate,  the  reliability 
a        of  measures  used.    Formula  and  procedures  were  given  by 
Guilford,  (1973,  pp.  417-418).     It\ should  be  noted  that 
this  Kuder-Richardson  formula  tends  to  underestimate 
the  reliability  of  a  test  (Guilford,  1973). 

RESUr;  AND  INTERPRETATION  Of  FINDINGS 

Analysis  of  the  Original  Memory  Score  (PRIG) 

me  original  memory  test  was  conducted  to  ensure  that  both 
the  field-dependent  aptitude  group  and  the  field- independent 
aptitude  group  were  equivalent  in  their  ability  to  memorize 
the  six,  original,  complete  designs  together  with  their 
nonsense  syllable  labels.    Comparison  of  the  two  group  means 
revealed  that  there  was  a  significant  difference  between  the 
ORIG  scores  of  the  two  aptitude  groups,  t  (149)  =  3.82, 
£<.001.     It  is  important  to  note  the  the  t  value  was  based 
on  a  separate  variance  estimate  because  of  the  violation  of 
the  homogeneity  assumption. 

Because  of  the  statistically  different  difference  between 
field-dependent  subjects  and  field- independent  subjects  on 
the  ORIG  test,  it  was  determined  that  subsequent  analyses  of 
all  test  measures  would  utilize  analysis  of  covariance  with 
the  ORIG  scores  held  constant  as  the  covariate. 

Analysis  of  the  Composite  Score 

HO!:  There  is  no  difference  in  performance  of  field-dependent 
or  fie Id- independent  subjects  on  a  test  of  analytic 
attitude.  * 
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,  The  null  hypothesis  was  rejected  for  the  total  performance 
measure  (the  composite  score).    That  is,  field- independent 
subjects'  total  performance  was  significantly  greater  than 
tield-dependent  subjects'  total  scores  on  a  test  of  analytic 
attitude.    Estimates  of  treatment  magnitude  (omega  squared) 
revealed  that  the  main  effect  for  aptitude  accounted  for  18% 
ot  the  total  variance.    According  to  interpretative  con- 
ventions proposed  by  Keppel  (1982)  and  Cohen  (1977),  this 
estimate  may  be  considered  to  represent  a  large  effect. 
Table  1  shows  a  summary  for  the  analysis  of  covariance  for 
the  composite  score. 

Analysis  of  Variations  Scores  1-6 

H02:  There  is  no  significant  difference  in  performance  of 
field-dependent  or  field- independent  subjects  for  any 
of  the  design  variations  on  a  test  of  analytic  attitude. 

The  null  hypothesis  was  rejected  for  each  of  the  six 
variation  scores.    That  is,  field- independent  subjects' 
scores  were  significantly  higher  than  field-dependent 
subjects'  scores  on  each  of  the  design  variations  in  a  test 
of  analytic  attitude  (see  Tables  2-7).    Estimates  of 
treatment  magnitude  (omega  squared)  revealed  that  the  main 
effects  for  aptitude  accounted  for:     (a)  6.2%  of  total 
variance  on  the  variation  1  score;  (b)  16.2%  of  total 
variance  of  the  variation  2  score,     (c)  9%  of  total  variance 
on  the  variation^  score;  (d>  7%  of  total  variance  on  the 
variation  A  score;  (e)  20%  of  total  variance  on  the 
variation  5  score;  (f)  19%  of  the  total  variance  on  the 
variation  6  score.    These  tests  of  treatment  magnitude  for 
variation  2,  5  and  6,  suggest  that  aptitude  differences 
accounted  for  large  proportions  of  the  total  variance  for 
each  of  these  three  measures. 


Post  hoc  analyses  of  power  revealed  that  the  size  of  the 
effects  for  aptitude  plus  the  large  sample  sizes  and  smali 
error  term  combined  to  result  in  extremely  high  power 
estimates  (>.95)  for  all  of  the  variations  scores  and  the 
composite  score.    These  results  increased  the  confidence 
U)  the  sensitivity  of  the  experiment  to  detect  real 
differences,  and  (b)  the  correctness  of  all  decisions  to 
reject  null  hypotheses. 

The  reliability  coefficients  for  variations  r_  =  .61 
(variation  1)    r         70  (variation  2),rfct  =  (variation 
U  /At  ,<6?  <vff*atioi>  A),  r     =  .64  (viriation  5),  r^ 
.65  (viriation  6),  and  rtt  =  r§2  (composite  score).  lt 

Cronbach  and  Snow  (1977)  have  recommended  the  inclusion  of 
descriptive  statistics  in  the  analysis  of  data  relating  to 
subject  aptitude.    Consequently,  aptitude  group  means  and 
standard  deviations  have  been  presented  in  Table  8. 
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Results  of  Hartley's  Test  of  Homogeneity  of  Variance  for  all 
post test  scores  are  reported  in  Table  9. 

Discussion  and  Interpretation  of  Results 


In  summary,  performance  on  a  test  of  embeddedness  and  cog- 
nitive restructuring  (GEFT)  was  found  to  be  highly  related 
to  performance  on  a  Test  of  Analytic  Attitude.  The 
relationship  between  these  measures  can  be  interpreted  to 
support  a  view  of  common,  underlying  analytic/non-analytic 
tendencies  (cf.  Messick  and  Fritzky,  1963;  Wachtel,  1968). 
Findings  should  not  be  interpreted  to  mean  that  non- analytic/ 
analytic  attitude  and  field-dependent/field-independent 
cognitive  style  are  identical  constructs.    The  redefinition 
of  field-dependence- independence  within  differentiation 
theory  has  extended  this  dimension  from  a  narrow  perceptional 
view  to  a  broader  multidimensional  view  of  individual 
functioning. 

Results  confirm  Wachtel* s  finding  (1968)  of  a  general 
superiority  for  field- independent  subjects  in  identifying 
element,  figural  form  and  background  aspects.    Both  the 
results  f rom  the  present  study  and  the  results  from 
Wachtel,  are  somewhat  inconsistent  with  those  of  Messick 
and  Fritzky  (1963),  who  found  that  the  field-dependence- 
independence  dimension  related  only  to  the  element  variations 
of  the  original  designs.    Wachtel  (1968)  found  almost  all 
variation  types  to  be  significant.    He  noted  that  he .had  used 
a  powerful  experimental  design.    Messick  and  Fritzky  did  not 
use  extreme  groups.    Instead,  they  utilized  an  unselected 
ample  of  subjects  representing  a  wide  range  of  Embedded 
Figures  Test  (EFT)  scores.   ,The  present  study  supports 
Wachtel' s  assertion  that  a  positive  relationship  between  all 
scores  for  design  variations  on  a  test  of  analytic  ability 
and  EFT  performance  will  be  revealed,  if  the  more  powerful 
extreme  groups  design  is  used. 

Study  of  differentiation  theory  has  extended  this  dimension 
from  a  narrow  perceptional  view  to  a  broader  multidimensional 
view  of  individual  functioning.     It  is  suggested  that  the 
observed  relationship  between  performance  on  the  Group 
Embedded  Figures  Test  and  a  Test  of  Analytic  Attitude 
illustrates  differentiated/analytic  tendencies  which  can  be 
related  to  aptitude  processes  strategies  and  resultant 
performance  in  a  concept  attainment  'task.    The  following 
interpretation  of  findings  is  offered: 

The  attainment  of  concepts  from  line-drawings  is  favored  by 
more  analytic,  differentiated  modes  of  processing.  The 
successful  application  of  this  mode  allows  more  differen- 
tiated field- independent  individuals  to  avoid  domination  by 
the  overall  organization  of  the  stimulus  field,  the  embedding 
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context.    As  a  consequence  these  learners  are  more  able 
to  isolate  analytically,  the  relevant  concept  attributes. 
This  serves  as  a  necessary  prerequisite  for  competent 
execution  of  processes  through  which  the  concept  attributes 
are  defined,  combined  and  associated  to  form  each  concept. 
For  field- independent  learners,  these  processes  have  been 
associated  wit,h  wholist,  hypothesis- testing  strategies.  The 
isolation  of  all  relevant  details  is  imperative  in  order  to 
form  a  comprehensive  first  hypothesis  which  will  subsequently 
be  tested,  modified  and  revise*!  through  this  hypothesis- 
testing  strategy.    Extremely  field-dependent  individuals  are 
less  capable  of  differentiated  functioning.    They  appear  to 
experience  difficulty  in  overcoming  the  embedding  context 
and  thus  lack  the  restructuring  ability  necessary  to  isolate 
relevant  details.    Their  difficulty  is  particularly  apparent 
when  processing  time  is  limited  by  externally-paced 
presentations. 

Thus,  the  difficulty  evidenced  in  isolating  details  (part 
aspects)  of  the  visual  may  inhibit  competent  execution  of 
processes  through  which  the  concept  attributes  may  be 
defined,  combined  and  associated  to  form  each  concept.  These 
results  provide  the  following  instructional  design  challenge; 

Given  an  aptitude  variable  and  some  analyses  of  the 
processes  it  reflects,  one  then  asks:    What  instruc- 
tional techniques  would  make  this  competence  especially 
relevant  to  learning?    What  would  a  treatment  have  to 
provide  to  make  learning  easy  for  the  low-aptitude  S? 
(Cronbach  and  Snow,  1977,  p.  172) 

Investigations  to  answer  this  challenge  are  needed  to 
provide  real -world  significance  for  the  practitioner  who 
uses  line-drawings  to  teach  concepts  and  wishes  to  consider 
cognitive  style  attributes.     Such  a  blend  of  research, 
theory  and  practice  is  imperative  for  the  design  of  aptitude 
sensitive  instruction. 
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Table  1 

Analysis  of  Covariance  for  Scores  on  the  Cosqpcaits 
Measure       (Study  XX) 


Source  of  Variance 

ss 

df 

MS 

F 

(ORZG)  -  Cov&riate 

2697.265 

1 

2697.265 

55.121 

Aptitude 

2974.712 

1 

2974.712 

66.791* 

Explained 

5671. 97e 

2 

2835.988 

57.956 

Residual 

10569.567 

216 

48.933 

m 

TOTAL 

16241.543 

218 

74.502 

*     £  <.0001 
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Table  2 


Analysis  of  Covaxiance  for  Scorae 

(Study  XI) 


on  Variation  Z 


Source  of  Variance 

S3 

df 

MS 

P 

(GRIG)  -  Covarlata 

85.336 

1 

85.336 

52.151 

Aptitude 

30.995 

1 

30.995 

18.942* 

Explained 

116.331 

2 

58.166 

35.546 

Residual 

353.449 

216 

1.636 

• 

TOTAL  1 

469.781 

218 

V 

2.155 

er|c 
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Tabic  3 

analysis  of  Cover iarice  for  Scores  on  Variation  2 

(Study  II)  , 


Source  of  Variance 

88 

dff 

'  MS 

P 

(Orig)  -  Covariata 

90.346 

1 

90.346 

35.592 

Aptitude 

126.873 

1 

126.873 

49.982* 

Explained 

217.218. 

2 

108.610 

42.787 

Residual 

548.288 

216 

2.538 

TOTAL 

765.507 

218 

3.511 

•  £<  .0001 
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Table  A 


Analysis  of  Covarianca  for  Scores  on  Variation  3 


(Study 

ID 

Souxc*  of  Varianc* 

ss 

at 

MS 

.  * 
ejaj 

F 

(QRIG)  -  Covariate 

69.107 

1 

89.107 

45.852 

Aptitude 

53.860 

1 

53.860 

27.714* 

« 

Explained 

142.967 

2  ■ 

71.484 

32.783 

Residual 

419.772 

216 

1.943 

TOTAL 

562.740 

218 

2.581 

J     •    p<  .001 
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Tabic  5 


Analysis  of  Covar lanes  for  Scores  on  Variation  4 

(Study  XX) 


Source  of  Var  lanes 

88 

df 

MS 

F 

(ORIG)  -  Covariats 

105.401 

1 

105.481 

55.182 

Aptitude 

43.961 

• 

1 

43.961 

22.998* 

Explained 

149.442 

2 

74.721 

39.090 

Rssidnal 

412.687 

216 

1.912 

• 

TOTAL 

562.329 

218 

2.579 

•  p<  .001 


Sable  6 


Analysis  of  Cover ience  for  Scores  on  Variation  5' 

(Study  ZZ) 


Sourca  'of  Variance  SS  df 


(ORIG)  -  Covariata  33.190        1  33.190  13.545 

latitude  140.034        1  140.034  57.146" 

Explained  173.224        2  86.612  35.346 

Residual  529.296  216  2.450 

TOTAL  702.521  218  3.223 


*  £  <.0031 
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Analysis  of  Covarianc*  for  Score*  on  Variation  € 

(Study  II) 


Source  of  Variance 

ss 

df 

MS 

F 

(ORXG)  -  Covariate 

67.072 

1 

67.072 

30.258 

Aptitude 

t 

129.381 

1 

129.381 

58.367* 

Explained 
Residual 

196.453 
478.807 

2 
216 

98.227 
2.217 

44.312 

TOTAL 

675.260 

218 

3.098 

*    £  <.0001 
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TABLE  8  .  . 

Group  Means  and  Standard  Deviations  for  Field-Dependent  and 

Field- Independent  Aptitude 


Test  Measure 


APTITUDE 
Field-Dependent 


ROW 

Fiel<£-  Independent 


X 

<SD> , 

n 

X 

(SD) 

n 

X 

n 

a 

Original  Score 

5.72 

(0.62) 

113 

5.95 

(0.21) 

106 

210, 

1. 

Variation  1 

4.12 

(1.61) 

113 

5.15 

(1.10) 

106 

4.62 

219 

2. 

Variation  2 

2.56 

(1.68) 

113 

4.35 

(1.60) 

106 

3.42 

219 

3. 

Variation  3 

3.88 

(1.73) 

113 

5.15 

(1.20) 

106 

4.49 

219 

4. 

Variation  4 

3.74 

(1.71) 

113 

4.95 

(1.23) 

106 

4.33 

219 

5. 

Variation  5 

2.24 

(1.56) 

113 

3.98 

(1.62) 

106 

3.08 

219 

6. 

Variation  6 

3.83 

(1.62) 

113 

4.59 

(1.41) 

106 

3.68 

219 

Composite  Score 

19.33 

(8.04) 

113 

28.20 

(6.79) 

106 

23.62 

219  / 

o   
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TABLE  9 

Results  of  hartley's  Test  of  Homogeneity  of  Variance 

for  all  Posttest  Scopes 


Test  Measure 


Largest 
Variance- 


Smallest 
Variance 


df 


max 


a. 

Original  (ORIG)  Score 

0.3823 

0 . 0454 

2,112 

8.45* 

1. 

Variation  1 

<*• 

2.5986 

1. 2012 

2,112 

2.16* 

2. 

Variation  2 

2.8325 

2 . 5504 

2,112 

1.11* 

3. 

Variation  3 

2.9929 

1.4400 

2,112 

2.08* 

4. 

Variation  4 

2 . 9207 

1.5228 

2,112 

1.92* 

5. 

Variation  5 

2.6374 

2.4196 

2,112 

1.09* 

6. 

# 

Variation  6 

2 . 6244 

1.9994 

2,112 

1.31* 

Composite  Score 

'*  n  <   .AC      '  ' 

64,6416 

46 . 1041 

• 

2,112 

1.40* 
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RESEARCH  AND  THEORY  INTO  INSTRUCTS DUAL  PRACTICE: 
A  REALISTIC  CHALLENGE  OR  AN  IMPOSSIBLE  DREAM 


Margaret  (Meg)  French,  Ph.D. 
Southern  California  Edison  Company 


To  many  in  our  profession,  linking  research  theory  with  practical 
implementation,  nay  appear  to  be  an  impossible  dream.    Practitioners  are 
the  potential  "knowledge  users"  of  research  findings  and  theory  who 
search  for  information  to  assist  practical  implementation  in  an 
instructional  setting.    A  "knowledge  user"  may  be  likely  to  assert  that 
"the  only  true  test  of  value  for  instructional  theory  lies  in  the 
extent,  if  any,  to  which  it  improves  [the  end  result  of)  instruction  and 
student  learning  (Snelbecker,  1983,  p.  441).    Conversely,  those 
theorists  and  researchers  who  are  "knowledge  producers,"  may  tend  to 
view  research  findings,  principles  and  theories  as  end  results" 
(Snelbecker,  1983,  p.  440).    Because  of  these  difficult  perspectives, 
both  extremes  may  be  skeptical  of  the  worth  or  utility  of  linking 
research  and  practice,  as  suggested  by  Passmore's  perception  that  "there 
is  nothing  so  practical  as  good  research"  (1984,  p.  24).  Many 
"knowledge  producers"  may  be  little  concerned  with  practical 
implications  because  of  their  commitment  to  obtain  and  interpret 
empirical  findings  relevant  to  the  research.    Is  there  as  Morell 
suggests,  a  "'culture  gap'  between  those  who  'do'  and  those  who  'find 
out'?"  (1984,  p.  7).    Jackscu  and  Kieslar  (1977)  have  observed  that  most 
practitioners  prefer  to  rely  on  experience  and  intuition,  rather  than  to 
turn  to  researchers  for  advice.    At  best,  there  could  be  greater 
interplay  between  knowledge  users  and  knowledge  producers  (Shoemaker, 
1984) . 

If  disciplined  inquiry  using  the  research  process 
should  be  used  to  find  a  solution  to  instructional 
problems,  then  it  becomes  necessary  to  reduce  the 
separation  between  research  and  practice.  "This 
alienation  should  not  exist  in  an  active,  creative 
profession"  (Passmore,  1984,  p.  26). 

Theorists,  researchers  and  practitioners  should  consider  their 
professional  charter  to  be  that  Of  a  problem-solver  (cf .  Plomp  and 
Verhagen,  1983).    As  problem- solvers,  we  need  to  respond  to  the 
challenge  of  integrating  research  findings  within  models  which  may  bqp 
used  to  meet  the  needs  of  practitioners.    As  knowledge  producers,  we 
need  to  create  models  which  establish  a  dynamic  balance  between 
research,  theory  and  practice.    This  problem- solving  challenge  is  based 
on  the  premise  that  it  is  not  an  impossible  dream  for  a  professional  in 
our  field  to  answer  the  following  questions:  ^ 

1.     Given  a  defined  training/ instructional  need  or  problem,  can  we 
recommend  appropriate  solutions  with  a  high  degree  of  confidence? 
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2.  Can  we  develop  models  derived  from  research  end  theory  to  help  us 
define  alternative  solutions  which  consider: 

o  reliability, 
o  validity, 

o       generalizability  of  research  findings? 

3.  Can  we  rely  on  the  technology  of  our  field  to  provide  these 
solutions?  , 

Let's  look  at  these  three  questions  and  their  implications  in  more 
depth .  -  (, 

1 .      Given  a  defined  training/ instructional  need  or  problem,  can  we 

recommend  appropriate  solutions  with  a  high  degree  of  confidence? 

Before  answering  this  question  it  is  important  to  review: 

o       the  difference  between  prescriptive  and  descriptive  theories 
and  the  implications  of  this  difference  on  finding  solutions. 

o  causes  for  difficulty  in  translating  principles  from  learning 
theory  and  instructional  theory  into  instructional  design  and 
development. 

The  goal  of  a  prescriptive  theory  is  to  prescribe  optimal  methods  of 
instruction  (Glaser,  1976;  Reigeluth,  1983;  Snelbecker,  1974).  This 
goal  may  be  contrasted  with  the  goal-free  nature  of  a  descriptive  theory 
which  aims  to  describe  the  processes  of  learning/ instruction.  Reig-luth 
(1983)  has  summarized  the  distinction  between  descriptive  and 
prescriptive  theories  (see  Figure  1).    His  model  suggests  that 
descriptive  theories  establish  condition  and  method  variables  as 
independent  variables  which  may  interact  to  produce  effects,  i.e., 
instructional  outcomes  which  are  dependent  variables.  Descriptive 
instructional  theory  places  emphasis  on  investigating  instructional 
variables,  i.e.,  how  information  is  presented  to  the  student.  In 
contrast,  prescriptive  theories  establish  the  desired  outcomes  and 
conditions  as  independent  variables  which  may  interact  and  be  used  to 
prescribe  appropriate  instructional  methods.    That  is,  descriptive 
theories  describe,  outcomes  and  effects,  whereas  prescriptive  theories 
are  concerned  with  prescribing  a  model  which  will  be  optimal  in  reaching 
desired  outcomes  under  different  conditions.  " 

The  act  of  recommending  appropriate  instructional  solutions  implies  an 
ability  to  prescribe  a  program  of  instruction.    Confusion. emerges  when 
there  is  an  expectation  that  a  prescriptive  theory  and  an  instructional 
program  can  be  derived  from  a  descriptive  theory  (Lands,  1983).  *  As 
Landa  explained,  a  prescriptive  theory  and  program  of  instruction  cannot 
be  derived  directly  from  a  descriptive  theory. 

Suppose,  for  example,  that  a  descriptive  learning 
theory  says  that  if  a  person  better  understands  s 
text,  then  he  or  she  remembers  it  more  easily. 
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(Or:    In  order  to  more  easily  memorize  the  text, 
it  is  important  to  better  understand  it.)  From 
this  seems  to  follow  s  prescriptive  instructional 
rule:    In  order  for  a  learner  to  better  memorize 
the  text,  it  is  necessary  (or  sufficient)  to  teach 
.  him  or  her  how  to  understand  it  (or  bring  him  or 
her  to  understanding  it).    This  derived 
prescriptive  instructional  proposition  is  not, 
however,  completely  true  and  comprehensive.  Of 
course,  in  order  to  secure  that  a  learner 
memorizes  a  text  better,  it  is  important  to  make 
sure  that  he  or  she  understands  it  or  to  teach  him 
or  her  how  to  understand  it.    But  understanding  is 
just  one  of  the  conditions  leading  to  better 
memorizing,  and  to  secure  (or  teach)  the 
understanding  is  not  sufficient  for  gaining  the 
best  results  in  memorization.    Other  factors  not 
mentioned  in  these  propositions  of  learning  theory 
(both  descriptive  and  presciptive)  should  be  taken 
into  account.    They  are  stated  in  other 
propositions  of  a  learning  theory  (if  it  is 
•    complete).    Kit  the  learning  theory  does  not  tell 
anything  about  which  of  its  propositions  should  be 
taken  into  account  and  combined  (and  precisely  how 
combined)  in  order  to  state  an  effective 
prescriptive  instructional  proposition  (Lands, 
1983,  pp.  65-66). 

A  further  confusion  may  emerge  when  learning  theory  and  instructional 
design  theory  are  confused.    As  Relgeluth,  Bunderson  and  Merrill  (1982) 
have  pointed  out,  prescriptive  learning  theory  is  not  synonymous  with 
prescriptive  instructional  design  theory.    Because  theory  of 
instructional  design  focuses  on  methods  of  instruction  it  is  relatively 
easy  to  apply  in  instructional/training  settings.    However,  learning 
theory  is  more  difficult  to  apply,  because  it  focuses  on  the  learning 
process  and  conditions  of  learning  for  which  instruction  must  still  be 
developed . 

A  final  point  of  confusion  often  occurs  when  the  instructional  design 
'blueprint"  is  confused  with  the  expectations  for  an  instructional 
developmental  model.    Instructional-design  blueprints  "indicate  what  the 
instruction  should  be  like,  whereas  development  models  indicate  how  to 
make  it  that  way. . . .  There  is  a  very  real  important  difference" 
(Reigeluth,  1983,,  p.  24). 

In  summary,  given  a  defined  training/instructional  need  or  problem,  the 
recommendation  of  an  appropriate  solution  needs  to  be  based  on  the 
realization  that: 

o      only  prescriptive  instructional  design  theory  pieces  emphasis 
on  methods  snd  how  information  should  be  presented  to  a 
student. 

o      descriptive  theories  can  not  be  directly  translated  into 
instructional  prsctice. 
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2.     Can  we  develop  models  derived  from  research  and  theory  to  help  us 
define  alternative  solutions which  considers 

o  reliability, 
o  validity, 

o      generalizahility  of  research  findings? 

In  the  past,  many  researchers  have  interpreted  the  discovery  of 
psychological  effects  to  be  a  complete  research  finding  (Salomon, 
1974).    Although  this  is  appropriate  in  many  fields,  instructional 
research  carries  the  added  criterion  of  effectiveness  (Saloaon,  1974). 
The  criterion  of  effectiveness  is  evident  in  the  teaching  of  most 
educational  research  Methodology  courses  in  which  students  ore  cautioned 
to  contemplate  upon  propo-sd  findings  and  to  ask,  "So  what?"  This 
question  goes  beyond  simple  justification  of  the  purpose  of  the  study. 
By  asking  "So  what?"  a  researcher  questions  the  value  of  the  effects  as 
they  relate  to  total  instructional  effectiveness.    This  added  criterion 
of  effectiveness  in  instructional  research  suggests  that  it  is  net 
enough  for  a  problem-solver/researcher  to  study  generalized  effects 
alone  (Salomon,  1974).  , 

When  considering  the  development  of  effective  models  from  research 
theories  several  realities  need  to  be  addressed: 

o      Many  theories  have  been  developed  outside  the  practical  world  of 
instructional  development/design  (Diamond,  1978). 

o      Researchers  have-  tended  to  focus  on  -studies  of  instructional 

"effects"  rather  than  instructional  "effectiveness"  (Salomon,  1974, 
1979). 

o      Theoretical  contributions  have  been  reduced  by  misplaced  emphasis 
on  gross  media  comparisons  ("Research  with  media")  ss  opposed  to 
"Research  on  media"  (Salomon  &  Clark,  1977).    Research  with  media, 
e.g.,  TV  versus  film  comparisons,  have  failed  to  provide  knowledge 
about  a  specific  medium,  and  the  way  that  individual  learners  learn 
from  the  presentations. 

o  Practical  research  studies  sre  scarce  because  of  the  difficulties 
in  conducting  classical  experimental  designs  within  the  framework 
of  day-to-day  instruction  (Clark,  1971;  Diamond,  1978). 

o      Key  limitations  and  problems  associated  with  various  theoretical 
models  are  rarely  reported  (Diamond,  1978).    As  Diamond  pointed  out 
probably  we  all  have  had  the  experience  of  discussing  a  model, 
theory,  or  program  with  its  instigator  only  to  discover  major 
limitations  which  were  omitted  from  what  we  had  read  or  heard. 

It  is  important  to  remember  that  research  techniques  designed  to 
establish  cause  and  effect  relationships  may  not  be  suitable  for  studies 
of  effectiveness.    Research  designs  appropriate  for  laboratory-oriented 
research  may  impose  "artificial  and  unrealistic  constraints  on 
decision-oriented  (situation  specific)  questions"  (Heinich,  1984,  p. 
84).    The  quasi-experimental  approaches  described  by  Campbell  and  Stanley 
(1963)  are  of  growing  importance  to  researchers  in  our  field.  Campbell 
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and  Stanley  have  stressed  that  when  full-experimental  control  1b  lacking 
aa  in  a  quasi-experimental  design,  it  is  crucial  for  the  researcher  to 
consider  those  variables  which  the  research  fails  to  control.  They 
recommend  that  the  reseacher  actually  seeks  out  such  threats  to 
validity,  so  that  there  is  a  sound  awareness  of  potential  competing 
interpretation  of  the  data.    Confidence  in  the  internal  validity, 
reliability  and  generalizability  of  the  research  can  be  Maintained. 
Diamond  (1978),  Heinich  (1984),  and  others  are  calling  for  a  movement 
away  fro*  experimental  to  store  naturalistic,  field-based  studies. 
"I  aa  not  implying  less  rigorous  study.    In  my  view,  a.  naturalistic 
study  nust  be  store  disciplined,  store  perceptive,  if  less  Mathematical , 
than  an  experimental  study"  (Heinich,  1984,  p.  85). 

The  writings  of  Gagne  (1977),  Snow  (1970),  Kaufman  (1983),  Merrill 
(1977),  and  Salomon  (1979),  to  name  a  few,  have  attempted  to  provide 
insight  for  practitioners  who  in  their  day-to-day  experience  do  not  have 
^time  to  investigate  relevant  research  before  implementing  a  solution  to 
an  instructional  need/problem.    A  common  perception  is  prevalent 
throughout  these  writings;  that  is,  there  is  a  need  to  derive 
principles,  theoretical  models,  skeleton  hypotheses  as  a  basis  for 
integrating  research  and  practice. 

Before  the  "knowledge  user'Vpractitioner  can  apply  effective 
instructional  strategies,  the  "knowledge  producer"  must  derive  and 
validate  prescriptive  principles,  and  construct  and  test  prescriptive 
theories  and  models  of  instruction.    Reigeluth  (1983)  has  extended  Snow's 
(1971)  theory-construction  procedures.    In  Reigeluth' s  procedure  the 
following  steps  were  proposed: 

Step  1:    Develop  formative  hypothesis  about  instructional  design  on  the 
basis  of  experience,  intuition,  and/or  logic. 

Step  2:    Develop  a  taxonomy  of  variables  related  to  instructional 
design.    "It  is  usually  best  to  start  with  a  clear  description  of 
.desired  outcomes.    Then,  generate  as  many  methods  as  you  can  for 
achieving  those  outcomes.    Finally,  identify  different  conditions  that 
will  influence  which  methods  will  work  best"  (1983,  p.  31).    In  other 
words,  this  step  involves  identifying,  describing  and  classifying 
variables  that  may  impact  instructional  design  theory. 

Step  3:    Derive  principles  of  instructional  design.    This  step  relies 
heavily  on  experience,  intuition  systematic  thought  to  postulate  the 
principles  and  upon  empirical  research  to  test  them. 

The  principles  postulated  in  this  step  usually  define  cause  and  effect 
relationships  among  variables  identified  in  the  previous  step  which 
relate  to  formative  hypotheses  developed  in  Step  1. 

Step  4s    Develop  models  and  theories  of  instructional  design.  As 
Reigeluth  recommended  "theories  csn  be  developed  by  integrating  strategy 
components  into  models  that  are  likely  to  be  optimal  for  different  sets 
of  conditions  and  outcomes. .. .the  methodology  is  very  different  than 
that  for  deriving  and  testing  principles.    Stepwise  multiple  regression 
csn  be  used  to  rank  order  the  contribution  of  each  strategy  component  to 
the  instructional  outcomes ,  when  adjusted  for  all  strategy  components 
that  contribute  more"  (1983,  p.  31). 


Reigeluth  noted  that  the  order  of  the  preceding  steps  may  change.  For 
example,  Steps  3  and  4  could  be  interchanged  depending  on  whether  an 
inductive  or  deductive  approach  was  used.    This  procedure  say  form  a 
promising  baais  for  future  development  of  models  derived  from  research 
and  theory. 

3.     Can  we  rely  on  the  technology  of  our  field  to  provide  these 
solutions? 

In  order  to  find  solutions  to  instructional  problems,  there  must  be  a 
phase  which  emphasizes  data  collection  and  data  analysis.    The  results 
of  the  analysis  phase  needs  to  be  integrated  into  a  subsequent  phase  of 
ongoing  synthesis  to  facilitate  development  of  a  comprehensive  theory 
(Martin  &  Driscoll,  1984;  Reigeluth,  1983).    We  have  an  ever  growing 
need  to  reap  the  benefit  of  knowledge  produced  within  our  field.    Ve  amy 
meet  this  need  through  the  use  of  synthesis  and  the  recognition  of 
commonalities  across  different  philosophical  perspectives.    We  need  to 
■eet  the  further  challenge  of  how  to  reconcile  seemingly  opposing; 
theories.    As  Clark  noted: 

There  are  at  least  three  factors  that  provide  a 
very  encouraging  context  for  focus  snd  integration 
of  theory:    First,  there  are  sinply  too  many 
design  Models  with  overlapping  purposes,  variables 
and  predictions;  second,  to  those  who  have 
surveyed  many  of  these  Models  there  is  clear  if 
implicit  agreement  between  many  researchers  on  the 
type  of  variables  that  are  important  for  a  unified 
design  theory  (e.g.,  instructional  methods,  tasks 
and  constraints  such  ss  individual  differences); 
and  finally,  instructional  psychology  is  ripe  for 
a  major  attempt  to  reconcile  behavioral  and 
cognitive  approaches  to  instruction  and  learning 
(1984,  p.  120). 

In  a  recent  monograph,  Reigeluth  (1963)  has  incorporated  concise 
descriptions  of  models  provided  by  Merrill,  Scandura,  Cropper,  Aronson 
and  Briggs  and  other  instructional  design  theorists.    His  work 
represents  a  timely  contribution  to  a  growing  trend  of  attempts  to 
synthesize  information  about  instruction  snd  learning  into  prescriptive 
models. 

From  the  work  of  these  authors  and  others,  it  is  evident  that  knowledge, 
expertise  and  technology  is  available  to  those  who  wish  to  meet  the 
challenge  of  integrating  research  and  practice.    What  strategies  should 
we  employ  to  increase  such  interplay  so  that  we  can  rely  on  the 
technology  of  our  field  to  provide  solutions?   The  following  suggestions 
may  provide  appropriate  direction: 

1.     Open  Communications  * 

"Knowledge  producers'*  need  to  promote  open  communications  by: 

o      developing  formal  and  informal  networks  for  an  exchange  of 
information  across  groups,  i.e.,  psychologists,  instructional 
technologists,  designers,  training  developers,  researchers, 
instructors,  snd  administrators . 
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o      establishing  convention  forums  for  work  in  progress,  as  well 
ss  completed  studies  (cf.  Heinich,  1984). 

o      reporting  results  of  appropriate  studies  in  education  and 

training  Journals  as  well  as  journals  dedicated  to  reaearch.  ^ 

o      promoting  foruaa  for  "knowledge  users"  to  express  their 
problems  (cf.  Passmore,  1984). 

o      advocating  the  use  of  extensive  analysis  at  the  working  level, 
only  when  there  will  be  an  increased  return  on  the  investment 
of  tine  and  resources  (e.g.  to  determine  why  certain  learners 
aren't  learning  versus  across  the  board 
implementation)  (Diamond,  1978). 

o      using  professional  judgement  to  avoid  excessive  discussion  of 
complex  models  and  theories  with  client-practitioners.  As 
Diamond  (1978)  pointed  out,  practitioners  need  to  understand 
the  design  process  yet  usually  they  are  not  interested  in 
jargon,  models,  or  theory. 

People  whose  role  is  primarily  one  of  producing 
information  are  likely  to  be  rich  in  only  one  of 
the  various  types  of  power.    That  type  of  power  is 
expertise,  and  it  must  be  carefully  used  to  good 
advantage  in  establishing  one's  credibility,  in 
opening  up  communication  channels,  and  in  garnering 
influence  (Morel 1,  1984,  p.  7). 

Examine  graduate  instructional  technology  programs  to  ensure  that 
the  following  needs  are  met; 

o      an  emphasis  on  systematic  problem- solving  (cf .  Ploap  & 

Verhagen,  1983).    With  these  skills,  the  graduate  may  be  able 
to  resolve  the  conflict  between  a  knowledge  producer's  view  of 
"what  should  be  done,"  the  practitioner's  perspective  of  "what 
can  be  done,"  given  real  world  constraints  (e.g.,  time,  budget, 
resource  and  informational  limitations;  organisational  goals; 
biases  and  needs  of  decision-makers;  incentives  for  change) 
(cf.  Diamond,  1978;  Morell,  1984). 

o      a  climate  of  acceptance  for  dissertations  based  on 
naturalistic  research  methods  (Heinich,  1984). 

o      exposure  to  successful  models  which  have  been  integrated  and 
used  by  practitioners  (e.g.,  models  developed  by  military 
research  organizations). 

o      training  to  evaluate,  compare  and  contrast  the  strengths  and 
weaknesses  of  various  theories,  so  that  the  graduate  is  able 
to  defend  a  specified  model,  theory  or  process.    That  is,  the 
graduate  not  only  needs  to  understand  the  rationale  behind  the 
theory,  but  also  the  implications  for  application  in  their 
future  work  settings.  (Diamond,  1978). 
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o      encouraging  ***************  ^^Y^lTi  ?J* 

to  preveat  ln»trttctio«»l  problems  fron  occurring,  ss  well  •« 
strategies  to  provide  solutions  for  existing  problems  (cf . 
Davies,  1978). 

o      development  of  graduates  who  are  skilled  practitioners  and 
reflective  scholars  (Heinrich,  1978). 

m 

Integrate  the  roles  of  those  in  our  field. 

As  Heigeluth,  Bunderson  and  Merrill  (1982)  advocated,  we  need  to 
intenrate  the  efforts  of  the  "scientist"  who  discovers  principles, 
the  "technologists"  who  use  these  principles  to  develop  procedures 
.no  heurUtid,  and  the  practitioner  who  uses  these  procedure,  and 
heuristics  to  develop  instructional  aaterials.    This  may  De 
achieved  by: 

o      placing  research  and  development  activities  within  the*"* 
ornanizational  framework.    Shoemaker  (1984)  proposed  that 
tnese  professionals  be  placed  in  close  physical  proxi-ity  to 
facilitate  increased  transfer  of  information. 

Where  do  we  go  from  here? 

Ivor  Davie.  (1978)  ha.  challenged  our  field  to  ""f^^f^ 
begin  a  new  growth  pattern  baaed  upon  opening  up  the  Possibilities 
avSilable  to  use  through  aisdng  for  effectiveness  i^U  we  do.  A. 
the  result  of  aany  decades  of  research,  we  have  accumulated  a  vast 
amount  of  information  relating  to  theories  of  learning  and 
Auction.    It  is  reminiscent  of  .  giant  jigsaw  puxxle  with  each 
lied  of  research  information  equivalent  to  each  piece  of  the 
puzzle.    The  need  for  solution,  to  instnictioiial/train^  probl«. 
requires  that  we  as  professionals  are  not  only  concerned  with  the 
discoveryof  more  pieces,  but  also  stress  -ttempts  ^inte^ 
these  findings.    As  problen-solvers ,  we  need  to  assemble  the 
existing  piefes  within  a  picture  which  represent.  V -«J^J^. 
the  science  of  instruction.    Our  challenge  is  to  find   the  picture 
on  the  lid"s  which  will  integrate  the  efforts  of  all 
orofessionals— the  scientist  and  the  technologist  and  the 
Jra^itiontr     This  is  our  realistic  challenge  not  our  impossible 
dream!  \ 
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INTRODUCTION 


Planning »an  educational  action  research  Is  not  easy,  as  I  have 
learned  In  recent  years.    For  ray  research  studies  I  have  conducted 
many  Interviews  and  collected  various  case  studies;    I  have  exam- 
Ined  several  educational  action  research  projects.    As  a  result,  I 
can  cite  the  case  study  as  my  best  tool  for  clarifying  meanings  and 
working  out  strategies  that  can  facilitate  the  planning  and  execu- 
tion of  a  project.    Thus,  my  research  methodology  has  been  based  on 
case  study  strategies. 

It  is:     '  \ 

1  -  Philosophical,  with  a  survey  of\  Individuals' 

values;  . ' 

2  -  Anthropological,  since  these  were  the  working  tools 

of  the  participant  observers;  and 

3  -  Pedagogical,  oriented  toward  research  based  on  an 

...    r  , 

educational  milieu. 
I  have  Investigated  the  salient  Information  about  theoretical 
and  practical  approaches  by  researchers  and  studied  their  research 
problems. 

The  data  i  report  here  projects  a  macroscopic  view  focusing  on 
the  socio-historic  and  educational  contexts  of  these  projects.  I 
call  this  approach  anthropological,  as  Is  the  microscopic  view. 

The  latter,  which  11 lunf nates  the  content  of  my  survey  In  a 
different  manner,  links  it  with  powerful  ideas  that  include  diver- 
gent and  contradictory  opinions,  .  s  well  as  descriptions  of  the 
educational  milieux. 
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1     The  difficulty  of  conducting  an  educational  action  research  project 

In  my  research  studies,  I  have  found  that  conducting  an 
educational  action  research  project  is  not  easy.    Even  well- 
organized  school  projects  travel  a  perilous  route.    For  instance, 
the  "Education  permanente  a  1  'elemental re**  project  (Continuing 
Education  project  at  the  elementary  level)  existed  approximately 
five  years,  gained  some  International  attention,  and  died.  Some 
other  projects,  such  as  "Ope'ratf  on-Human  I  sat  I  on  au  Saguenay-Lac 
Saint- Jean**  (Humanlsation  project  at  Saguenay) ,  "PERFORMA**  (In- 
Service  Training  project)  at  the  University  of  Sherbrooke  and  so 
on,  all  had  difficulties. 

We  may  ask  ourselves  these  questions:    how  can  a  research 
project  be  kept  on  track?    When  it  is.  alive  and  well,  what  train- 
ing, intervention  and  research  dialectic;  are  involved?    What  can 
kill  an  educational  action  research?    Is  it  because  researchers 
and  participants  fail  to  Invest  adequate  planning?    Are  the  re- 
search  and  intervention  models  inadequate?    In  the  domain  of^human 
relations,  is  there  any  dlss:jntlon  among  members 7    Are  a  combination 
of  these  internal  and  external  factors  creating  a  problem? 
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1 1    The  case  study; 

a  tool  for  collecting  and  analyzing  data 

t 

I  have  decided  that  the  case  study  method  Is  my  best  tool  for 
collecting  different  views  about  participants'  experiences  and  find- 
Ing  out  If  a  completed  school  research  retains  any  meaning  In  the 
years  following  Its  completion.    This  method  carries  validity  because, 
first  of  all,  a  case  Is  a  real  experience  taken  from  dally  life;  It 
Is  a  problem  situation  needing  diagnosis.    Data  must  be  collected, 
the  whole  context  must  by  analyzed,  and  a  problem  solving  mechanism 
must  be  dlvlsed.    (Kemmls,  S.,  I98O;  Lippltt,  G. ,  T980;  Mucchlelll,  R. , 
1972;  Stenhouse,  L. ,  1980;  Ardolno,  J.,  1980). 

When  I  began  collecting  data  about  an  educational  action  project, 
I  gathered  written  documents  such  as  reports,  scientific  tests,  govern- 
ment  grant  forms,  theses,  and  photographs,  as  well  as  audio-visual 
documents,  such  as  audio  and  video  cassettes.    I  analyzed  this  material 
in  the  light  of  my  research  problem:    What  Is  the  life  of  an  educa- 
tional project  with  an  action  research  orientation? 

I  also  interviewed  "key  informants"*  of  the  project,  taking  notes 
and  taping  conversations  of  the  school  principal,  school  board  admin- 
istrators, teachers,  parents,  students  and  project  researchers. 

When  interviewing  participants,  t  always  asked  specific  questions, 
such  as:    How  did  the  project  get  started?    What  was  occurring  when 
it  was  alive?    When  did  they  Join  the  project  and  what  did  they  do? 

236 
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Meeting  only  one  person  at  a  time,  I  conducted  all  my  Inter- 
views in  quiet  places,  eg.  an  office  or  a  living  room.    To  my  data, 
i  added  a  personal  journal  in  which  i  wrote  my  observations  about 
my  interviews,  their  circumstances  and  milieux,  and  so  forth. 

2. 1  The  analysis 

After  describing  the  action  research  project,  i  analyzed  my 

r 

data  with  an  eye  for.  action  research  procedures,  the  pedagogy 
employed,  evidence  of  participants1  value  systems,  and  so  on. 

2.2  Example  of  a  Macroscopic  view:    the  Continuing  Education 
project  at  the  elementary  level  ("EPEL") 

2.2.1.    A  look  at  the  1970's  in  Quebec  education 

"EPEL**  was  an  experimental  project  In  which  school 
administrators,  teachers  and  researchers  questioned 
teaching  methods,  innovative  pedagogies,  teacher 
and  student  attitudes  and  behaviors.    (Angers,  1978: 
225). 

To  more  fully  understand  this  project,  we  must  note  that  in 
the  1960's  Quebec  society  experienced  a  major  cultural  revolution. 
Participants  of  the  "EPEL"  project  were  Its  products. 

/ 

/ 

The  predominating  ideology  during  the  1960's  was  deeply  rooted 

in  theological  and  sociological  thought.    Grand' Ma  I  son/ writes: 

The  school  appeared  an  Important  symbol,  ensuring 
survival  of  the  Christianity  of  thes^  Cathol ics  In 

/ 

/ 


the  face  of  an  anglo-saxon  Protestant  world.  Social 
Institutions  and  values  were  evaluated  on  a  religious 
basis  (...).    The  Quebec  Christian  Ideology  was  con- 
centrated In  the  world  of  culture.    Government  policies 
worked  on  this  orientation.    With  the  Parent's  Report 
on  Education  and  the  creation  of  the  Department  of 
Education,  the  focus  shifted  from  the  church  to  the 
secular  authority,  that  Is,  the  government.  (Grand* 
Malson,  1970:  35). 

With  the  "revolution  tranquil  le~  (quiet  revolution)  a  partici- 
pative and  developing  ideology  Immerged  with  the  aim  of  preserving 
a  culture  different  from  that  of  other  North  American  groups  (Rfoux, 
1973). 

This  historical  background  influenced  the  "EPEL"  group's 
educational  policies  and  models.    For  example,  the  Parent  Report 
on  Education  counsels  emphasis  on  the  quality  of  teaching  rather 
that  quantitative  aspects;  it  urged  development  of  thinking  skills 
and  analytic  attitude.    (Parent,  1966,  T.  111:  191-203) 

With  this  in  mind,  "EPEl"  researchers  set  about  to  influence 
the  qualltlve  aspect  of  education. 

2.2.2    Pedagogy  in  the  province  of  Quebec 

Today  we  talk  a  great  deal  about  educational  models  (Leplne,  G. , 
1977)  and  paradigms  (Bertrand  et  Valois,  1982),  but  In  the  1960's 
Quebecers  talked  more  about  educational  concepts  and  Ideological 
orientation  (Paquette,  1976;  Parent,  1966;  Angers,  1978).  Some 
educational  orientations  predominated.    Among  them  were  the  classic 
pedagogy  or  traditional  Instruction  in  which  students  functioned 
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under  teacher  control.    "Free  teaching"  was  a  non-directive 
strategy  (Benjamin,  1982;  Paquette,  1976),  "Open  teaching",  which 
was  more  restrictive  than  the  latter  (Paquette,  1976;  Parfi,  1977), 
featured  several  orientations,  among  them  organic  pedagogy,  on 
which  the  "EPEL"  project  was  based. 

"EPEL"  researchers  described  their  pedagogy  In  the  following 
manner: 

Organic  pedagogy  puts  an  emphasis  on  developing 
insights  and  autonomy.    This  pedagogy  liberates 
because  it  opens  imaginative  and  creative  ways  to 
the  students.    It  Is  a  stimulus  which  encourages 
,        understanding  and  the  intuitive  powers.  * 

The  student  becomes  a  self-educator  who  learns 
by  means  of  human  interactions  in  a  conductive 
educational  environment. 

s 

2.2.3     Educational  research  in  Quebec  during  the  196Q's 

Education  researchers  in  Quebec  discovered  new  ways  during  the 
I960's.    Different  reports  about  education  urged  work  on  new  ap- 
proaches, such  as  joining  theory  and  action,  affect Ivity  and  intel- 
ligence, to  use  the  jargon  of  the  times. 

After  a  conscienti ration  about  the  accessibility  of  knowledge, 
action  research  fcbok  foot.    It  resolved  the  scientist's  Ideological 
problems  of  joining  theory  and  practice;  rather  than  separating 
them  as  in  classical  research,  it  combined  affectivlty  with  the 
cognitive  domain. 
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**EPEL~  researchers  strove  to  adapt  their  project  to  Ideas  cur- 
rent In  their  new  Quebec  society,  thus  initiating  an  action  research 
(Angers,  1978) . 

2.3    MICROSCOPIC  VIEW 

s 

This  part  of  the  case  study  deals  with  "EPEL's"  history, 
objectives,  ideology,  human  resources,  physical  circumstances, 
and  participants:    parents,  students,  teachers,  principal,  school 
board  administrators,  and  project  researchers. 

According  to  the  "EPEL"  researchers,  their  project  started  in 
the  autumn  of  1970  with  a  meeting  between  the  Three  Rivers  School 
Board  and  University  of  Quebec  administrators  at  the  local  campus. 
They  wanted  to  create  a  research  project  that  would  1  ink  educational 
theory  with  practice.    As  they  needed  a  school  to  realize  the 
experimental  part  of  their  project,  Star  Elementary  School  was 
designated  (Angers,  1973:  1). 

This  school  was  in  a  crowded  low- Income  area  In  Three  Rivers, 
a  city  of  200,000  inhabitants.  Around  Star  Elementary  School,  there 
are  factories,  many  two  or  three  level  houses  and  the  Saint  Lawrence 
Seaway.    One  side  of  the  school  Is  bounded  by  playground  and  the 
other  sides  by  streets. 

In  this  area  some  people  are  chronically  unemployed  and  must 
rely  on  government  help.    Many  children  from  such  families  attended 
Star  when  "EPEL"  was  going  on.    Almost  all  the  teachers  and  admin- 
istrators lived  in  other  parts  of  the  city. 
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2.3.1.  Objectives 

t 

i 

The  project's  objectives  were  to  study  (1)  various  aspects 
of  learning  activities;  (2)  the  human  being;  (3)  the  meaning  of 
learning  and  teaching,  especially  when  teacher  attention  is  given 
to  each  individual  student;  and  (k)  the  duties  of  students  and 
teachers  (Angers,  1971:  1). 


At  the  Ideological  level,  "EPEL"  researchers  wanted  to  study 
the  factors  that  influenced  relations  between  the  school,  Its 
parent  board  and  externa)  Institutions  such  as  the  Department  of 
Education. 

2.3.2.  Analysis:    vertical  and  horizontal  readings 

Under  the  vertical  readings,  I  discuss  the  interviews,  pointing 

■    ♦  i 
out  major  statements  —  eg.  concurrence  and  differences  in  view- 
points -  -  by  key  informants  In  the  same  group,  such  as  teachers  or 
parents.    With  the  horizontal  reading,  analysis  In  based  on  the 
opinions  and  efforts  of  all  key  participants.    Finally,  my  con- 
cluding section  links  the  data  revealed  by  the  participants  with 

« 

"EPEL's"  socio-historlcal  and  educational  context  and  the  theories 
proposed  by  1rs  researchers. 

2.3.3.  Example  of  the  "EPEL"  analysis:    vertical  reading 

I  Interviewed  school  board  administrators,  principals, 
researchers,  parents,  students  and  teachers  who  participated  In 
"EPEL".    Figure  1  shows  us  their  main  comments.  Administrators, 
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were  deeply  implicated  as  leaders  of  the  project.    The  acknowledged 
feeling  too  much  Involved  In  both  the  school  and  the  researchers' 
work.    They  expressed  the  belief  that  Star  School  deserved  to  have 
played  a  larger  voice  In  **EPEl*s"  planning. 


\ 

\ 
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MAIN  POINTS  IN  PARTICIPANTS1  INTERVIEWS 


ADMINISTRATORS 


RESEARCHERS 


TEACHERS 


PARENTS 


STUDENTS 


-  EPEL  squeezed  us  very 
much. 

# 

-  We  experienced  better 
Interpersonal  commu- 
nication and  human 
relations. 

-  We  developed  a  parti- 
cipative management 
throughout  the  whole 
school  board. 

-  Worked  as  equals. 

.We  felt  too  Involved 
^n  both  the  school 
and  the  researchers' 
work. 

Administrators' 
leadership  was  too 
strong. 

Administrators  and 
researchers  Imposed 
the  project!  fail Ing 
to  el iclt  col  1  a bo- 
ra t  ive  agreements  and 
Ideas  with  Star 
personnel . 
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Communications 
between  all  Involved 
groups  Influenced  us 

We  were  involved 
with  different 
participants  at 
various  levels  each 
year. 

Our  researchers' 
leadership  was 
excessive. 

We  planned  the 
research  primari ly 
with  the  adminis- 
trators only. 


We  improved  human 
relations,  talking 
with  and  understanding 
each  other  better. 
This  humanized  Star 
School . 

We  were  not  committed 
as  much  as  we  wished 
because  EPEL  was 
imposed  on  us. 

Researchers'  ideal 
were  too  theoretical. 

We  created  learning 
materials ,  experienced 
organic  pedagogy  in 
classrooms,  and 
received  a  training 
in  pedagogy. 


We  enjoyed  the 
welcoming  attitudes 
of  researchers  and 
teachers  at  Star 
School  and  the 
possibility  of  start- 
ing a  parents  1  school 
committee. 

We  did  not  feel 
involved  enough  In 
plar  Jng. 

We  were  well  Informed 
about  EPEL,  however* 


We  remember  the 
atmosphere  of  freedom 
at  Star  School  which 
facilitated  communi- 
cation between 
students  and  teachers. 

We  real  ire  that  we 
achieved  greater 
autonomy  In  compari- 
son with  our  friends 
In  other  schools. 
For  instance,  we  are 
better  prepared  to  do 
research  by  ourselves. 

As  soon  as  EPEi  was 
operating,  the  class- 
room environment 
changed  for  the 
better. 
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2.3.       Example  of  the  "EPEL"  project:    horizontal  reading 

2.3*4.1.    "EPEL"  and  action  research 

The  French  researcher  and  practitioner  Henri  Desroche,  and  his 
English  colleague  Check land,  describe  action  research  as  a  collective 
work  of  planning  by  researchers  and  participants.    It  Implies  also, a 
mutual  search  to  resolve  a  problem,  the  diagnosis  of  which  is  oriented 
toward  participants'  needs.    (Desroche,  1978;  Zun i ga ,  1981;  Barbier, 
1979;  Morln,  1981). 

a 

,  1 

Prof.  Desroche  says  that  there  are  several  action  research 
strategies.    The  first  one,  Action  Research  "ON"  (explanation);  It 
studies  an  action  without  the  factor  of  field  experience,  and  is 
oriented  toward  the  researcher's  analysis.    The  second  strategy 
Is  Action  Research  "For**  (focuses  on  application).    Agents  *ork  for 
the  participants,  presenting  analyses  and  working  strategies.  There 
is  also,  Action  "With".    Agents  work  with  the  participants,  planning 
the  action  research  together.  ^ 

2.3.4.2.    Diagnosis  of  problems 

0 

After  analyzing  the  Star  School  situation,  researchers  defined 

* 

its  problems.    They  noted  that  the  area  was  economically  poor  and 
that  Its  occupants  were  considered  "tough"  and  socially  deprived. 
After  "EPEL"  began,  Star  School  administrators  reported  less, van- 
dallsm  such  as  broken  windows  than  the  prevailing  level.    Teachers  * 
probably  Invested  with  their  students'  different  work  habits,  but 
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they  had  accommodated  themselves  to  these  behaviors. 
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Action  and  research 

During  a  six  month  period,  researchers  continued  to  examine 
Star's  problems  through  participant  observation  techniques.  They 
then  proposed  tentative  solutions  to  teachers  and  administrators 
In  training  sessions  about  organic  pedagogy? 

i 

\ 

Researcher  Math leu  told  me  "it  was  our  objective  to  test  our 
theory  In  an  educational'  setting.    Whenever  we  introduce  new 
educational  models,  we  need  to  train  teachers  .  .  .  Classrooms 
need  to  be  completely  transformed,  especially  by  modifying  teachers1 
pedagogical  attitudes.  * 

/ 

The  teachers,  however,  judged  the  researchers'  approach  to 
problems  was  too  theoretical  and  regretted  that  they  had  not  been 
Invited  to  plan  collaborative  strategies  with  them.    Despite  their 
reservation:,  they  accepted  help,  although  they  did  not  solicit  It. 

Parent,  told/  me  that  they  enjoyed  being  more  welcome  at  Star 
School  and  they"  approved  of  the  freedoms  that  were„  initiated. 
However,  they  were  dissatisfied  about  not  having  been  involved  in 
planning  "EPEL". 

As  Figure  1  reveals,  administrators  felt  quite  the  opposite 
about  their  role. 

IV 

The  researchers  did  not  impose  their  demands  but  tried  to 

0 

elicit  cooperation*,  receiving  It  in  varying  degrees.  These  responses 
show  that  action  research  la  more  effective  and  far  more  pleasant  for 
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participants  when  the  latter  group  no\  only  executes  plans  but.  helps 
to  devise  them.    Thus  teachers, •parents  and  administrators  who,  in 
this  case,  felt  too  deeply  involved  in  planning  (execution)  would 
have  experienced  greater  satisfaction,  (perhaps  would  have  modified 
project).  * 
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CONCLUSION 

*n  this  paper,  Instead  of  explaining  the  methodology  of  many 
educational  (action  research)  oriented  projects  In  Quebec  (which  I 
have  studied)  I  have  decided  to  deal  with  only  one  case  study  to  show 
the  contribution  of  this  method  to  human  development,  needs  assessment, 
curriculum  development .and  Innovative  teaching.    Using  the  case  study 
method,  I  understood  and  analysed  the  dynamics  of  other  projects  and 
gain  a  holistic  view  of  them. 

My  approach  is  a  design  which  will  permit  us  to  take  an  insightful 
look  at  current  needs  in  instructional  technology.    The  fundamental 
requirement,  however,  Is  to  work  methodically  with  a  tool  In  which  the 
researcher  plays  the  critical  role;    his/her  subjectivity  must  be  valued, 
and  empathy  with  subjects  must  be  viewed  as  essential  (Morln,  A.,  \S7S:  58) 

\  \ 
Using  case  studies  in  my  research  permits  me  to  pinpoint  the  essential 

conditions  of  some  aspects  of  action  research,  which  can  facilitate  the 

development  of  appropriate  pedagogical  models  for  today.    The  case  study 

method  Itself  is  not  new,  I  believe  its  use  In  Instructional  techno lopy 

reflects  a  new  trend,  at  least  in  my  part  of  Canada,  which  can  advance 

f  , 

\ 

educational  theory  and  research. 
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Abstract 

c 

The  purpose  of  this  study  was  to  examine  the  effects  of  the  locus  of 
three  computer-assisted  instruction  (CAI)  strategies  on  the  accuracy  and 
efficiency  of  mathematics  rule  and  application  learning  of  low  achieving 
seventh  grade  students.  The  three  CAI  treatments  were  an  externally 
controlled  adaptive  strategy,  an  individually  based  learner  control  with 
advisement  strategy,  and  a  no  control  linear  design  strategy.  Effects 
were  examined  for  CAI  strategy,  prior  achievement,  and  sex  of  student. 
Significant  differences  were  found  for  achievement  and  the  achievement 
by  scale  interaction,  with  the  below  average  group  yielding  better  rule 
recall  and  proportionately  greater  application  scores  than  low  students. 
The  no  control  linear  strategy,  however,  required  less  time  to  complete 
and  resulted  in  the  most  efficient  treatment. 


i 
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The  Effect  of  Adaptive  v  Advisement,  and, Linear 
CAI  Control  Strategies 
On  the  Learning  of  Mathematics  Rules 

In  recent  years  many  studies  have  dealt  with  various  issues  in 
computer  assisted  instruction  (CAI).  In  general*  CAI  has  been  found 
effective  in  increasing  performance,  improving  learner  attitudes,  and 
reducing  time-on-task  (Kulik,  Banger t,  &  Williams,  1983?  Kulik,  Kulik,  & 
Cohen,  1980).  The  locus  of  control  in  CAI  design,  learner,  computer,  or 
combined    control,    has  been  a  recurring,  but  as  yet  unresolved,  issue. 

The    amount    of    control  that  learners  can  effectively  manage,    and    the  , 

i  .  / 

factors  likely  to  affect  control  strategies,  are  not  generally  known. 

Most  studies  which  address  instructional  locus  of  control  focus  on 
either  external  program-level  adaptive  control  (Ross  &  Rakow,  1981; 
Rothen  &  Tennyson,  1978;  Tennyson  &  Rothen,  1977)  or  interna^/  learner 
control  with  varying  amounts  of  advisement  (Ross,  Rathow,&  Bush,  1980; 
Tennyson  1981;  Tennyson  &  Buttrey,  1980).  Adaptive ^computer  control  is 
typically  regulated  from  within  the  program,  dependent  upon  the 
learner's  prior  knowledge,  accuracy  of  responses  during  the  instruction, 
or    lesson    achievement  status.    Learner/control  usualiy  incorporates  a 

/ 

/ 

form    of    advisement,  which  informs  the  student  about    progress  towards 
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mastery,  and  s  prescription  for  full  mastery  (Tennyson  £ 'But trey,  1980). 
The  procedural  decisions  during  the  instruction,  however,  are  typically 
under  individual  learner  control.  Whereas  several  CAI  control 
strategies   exist,    the    relative     effectiveness     of.  various  control 

strategies  has  not  been  studied. 

*  > 
Several  factors  are  likely  to  Influence  learning  from  CAI.  Prior 

m 

student  achievement  was  a  key  influence  on  the  amount  of  instructional 
support  needed,  for  optimal  learning  (Tennyson  &  Rothen,  1977;  Ross  & 
Rakow,  1981).  Students  with  high  ability  or  prior  achievement  performed 
best  under  learner  controlled  instruction,  while  low  ability  students 
required  the  externally  imposed  program  control.  In  1981 v  Tennyson 
demonstrated  that  average  and  above  average  high  school  students 
effectively    managed  their  CAI  when  provided  continuous  advisement  as  to 

j 

achievement  and  instructional  needs.  It  is  not  known  to  what  extent 
such  strategies  affect  the  performance  of  younger  or  less  able  students. 

The  nature  of  the  learning  task  is  also  lively  to  exert  a 
controlling  influence.  Several  authors  have  noted  that  effective  rule 
teaching  procedures  require  instances  of  rule  information f  application, 
and  practice  (cf.  Scandura,  1972;  Tennyson  &  Tennyson.  1977).  The 
strategies  for  teaching  rule  use  and  application  are  different  from 
tS.\se  us*  J  to  teach  other  skills  (Gagne,  1977).  and  require  study  fof 
t omputer-basud  instruction. 

The    influence    of    sex    differences,    especially    related  to 
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mathematics,  is  also  of  importance  (Armstrong,  1981;  Benbov  &  Stanley* 
1980;  Fenneaa  ft  Sherman,  1977,1978).  Whereas  such  achievement 
differences  may  be  diminishing  (T.evine  &  Ornstein,  1983),  considerable 
controversy  remains.  If  such  differences  are  moderated  by  sociocultural 
influences,  such  as  tacit  teacher-student  interactions,  then  CAI  '  might 
be  effective  in  controlling  subtle  biases.  Presumed  mathematics-related 
sex  differences,  and  the  influences  of  various  CAI  design  strategies  on 
such  differences,  should  be  considered. 

Several  empirical  and  practical  issues  related  to  toe  design  and 
effectiveness  of  CAI  warrant  study.  The  purpose  of  this  study  was  to 
examine  the  effects  of  externally  versus  internally  controlled  CAI 
design  strategies  on  the  mathematics  rule  learning,  retention,  and 
efficiency  of  low  achieving  junior  high  students. 

Methods 

Subjects 

A  total  of  47  seventh  grade  students,  enrolled  in  low-achievement 
remedial  mathematics  classes,  participated  in  the  study.  Class 
placement  was  based  upon  poor  performance  on  a  standardized  test,  the 
Comprehensive  Test  of  Basic  Skills,  which  was  administered  eight  months 
prior  to  this  study.  Students  were  drawn  from  a  middle-class  school 
system,  consisting  of  a  majority  of  Anglo  and  a  minority  of  Hispanic  and 

.    '      .  256  . 

*    '257'  . 


CAI  Strategies 

other  ethnic  group  representation* 
Instructional  Materials 

The  instructional  task  selected  for  this  study  was  a  mathematics 
rule  lesson  concerning  divisibility  by  two,  three,  and  five.  Each 
treatment  consisted  of  the  same  basic  tutorial  CAI  progress,  designed  to 
teach  the  *ules  for  divisibility  by  two.  three,  end  five,  end  the 
application  of  these  rules  to  five  and  six  digit  numbers*  The  lesson 
•structure  was  based  upon  the  "Events  of  Instruction,"  and  adapted  to  CAI 
(Gagne,  1977;  Gagne,  Wagner,  &  Rojas,  1981).  Three  versions 
representing  different  CAI  design  strategies  were  developed* 

Adaptive  controls  This  version  consisted  of  externally  controlled 
CAI,  during  which  the  computer  branched  students  for  reteaching  or  more 
examples,  dependent  upon  the  accuracy  of  responses  during  the  lesson* 
Students  completed  the  entire  CAI  program  before  exiting  the  lesson* 
Students  had  no  control  over  the  pacing  or  amount  of  teaching  in  the 
lesson.  All  control  for  this  lesson  was  externally  regulated  through 
programming  commands;  students  advanced  only  when  correct  responses  were 
made  and  mastery  levels  were  attained* 

Learner  control  with  advisement*  This  treatment  consisted  of 
internally  controlled  CAI,  during  which  students  were  continuously 
advised  of  progress  toward  objectives,  but  permitted  to  determine  if 
reteachingf  additional  examples,  or  additional  problems  were  needed. 
Students    were    advised  that  they  should  answer  at  least    four  problems 

257 
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correctly  before  advancing  to  the  next  section.  However,  students  were 
free  to  continue  to  the  next  rule  at  any  time  after  the  tutorial  portion 
of  each  section* 

!!£  control.  This  treatment  served  as  control  for  the  study. 
Students  using  this  strategy  received  the  same  sequence  of  instruction 
and  examples  but  had  no  advisement,  no  individual  control  to  review  or 
to  select  additional  examples,  and  no  externally  imposed  program 
decisions  based  upon  the  accuracy  of  responses.  Students  were  only  able 
to  control  the  pace  of  the  instruction  by  advancing  through  the 
presentation  when  ready.    This  treatment  was  linear  CAI,  which  permitted 

« 

the    student  only  to  follow  the  predetermined  instructional  path.  Each 
student  was  required  to  complete  the  entire  lesson  before  proceedings 
Recall  and  Application  Tests 

Immediate  post  test.  A  25  item  five-part  multiple  choice  wrilteii 
post  test  was  administered  to  each  student  upon  completion  of  the  CAI 
program*  The  written  test  included  eight  questions  which  tested  rule 
recall  and  17  questions  which  tested  the  application  of  the  rules  for 
divisibility  by  twof  three,  and  five.  Recall  questions  required 
students  to  recall  the  test  rules  in  various  forms,.  Application 
questions  required  students  to  select  the  correct  four,  five,  or  six 
digit  number  vhich  was  divisibile  by  one  or  more  of  the  test  numbers. 
Test  numbers  of  this  size  were  chosen  to  assure  that  students  could  not 
easily  determine  the  answer  without  applying  the  rule. 
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Parallel  retention  test.    A  parallel  multiple  choice  test  ' of  25 
questions   was   given   to  test  retention  of  rules  end  ability   to  apply 
rules   learned  from  each  CAI  strategy.   The  parallel  test  was  identical 
to  the  immediate  test  in  form,  item  number,    and  item  type.    Each  of  the 

items   included  on  this  test  was  designed  to  mirror  a  corresponding  item 

i 

from   the  Immediate  test,  except  the  numbers  and  context  used  to.  elicit 

I 

the  rule  were  different.'  The  forms  were  validated  for  equivalence 
through  a  series  of  item  evaluations  conducted  independently  by  two 
researchers. 

The  reliability  of  the  achievement  tests  were  established  prior  to 
the    study    by  administering  the  immediate  post test,  then    the  parallel 
retention    test    one    week    later,  to  55  eighth    grade    students.  The 
parallel  form  reliability  of  the  test  was  .67. 
Teacher  Survey 

For  each  student,  the  student's  current  mathematics  teacher  rated 

« 

mathematics  ability  in  relationship  to  other  seventh  grade  students.  A 
five  part  rating  scale,  with  values  ranging  from  low  math  ability  to 
high  math  ability  was  used  in  this  rating.  The  survey  provided 
information  about  student  mathematics  capabilities  to  assure  that  all 
students  selected  for  this  study  were  below  average  mathematics 
performance • 
Dependent  Measures 

Dependent  variables  were  Immediate  posttest  and    retention  test 
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scores  for  both  rule  recall  end  rule  application.  In  addition,  the 
number  of  minutes  spent  on  the  instructional  task  was  collected  for  each 
student,  eng£  analyzed  both  separately  and  with  test  scores  ss  an 
indication  of  learning  efficiency.  The  learning  efficiency  score  Was  • 
measure  of  the  ratio  of  number  of  correct  responses  on  each  rule  imd 
application  test,  divided  by  the  number  of  minutes  required  .to  complete 
the  instruction.  *. 
Procedures 

Standardized  mathematics  scores  and  teacher  ratings  were  gathered 
for  each  student  prior  to  the  study.  The  -'Oth  percentile  was  the  median 
score  for  the  47  students,  and  was  used  to. classify  students  as  "below 
average"  or  "low"  in  prior  mathematics  achievement.  Those  students 
below  the  20th  percentile  were  classified  as  low,  and  those  above  the 
20th  percentile  as  below  average,  achievement  for  the  purposes  of  this 
study.  The  teacher  ratings  were  used  to  corroborate  these 
classiiications.  In  cases  of inconsistency  between  teacher  ratings  and 
standardized  test  scores,  student  data  were  excluded  from  the  analysis. 

Prior  to  the  study,  the  researcher  provided  general  information  to 
the  students  as  to  the  purposes  and  expectations  of  the  study.  During 
this  time  the  students  vera  instructed  in  the  elementary  operation  of 
the  microcomputer  to  be  used  in  the  project  and  were  given  a  short  time 
to  interact  with  another  CA1  lesson  similar  procedurally  to  the  lesson, 
used  in  the  present  study,  "  +  • 
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The  students  were  randomly  assigned  to  one  of  the  three  treatment 
groups,  stratified  to  ensure  that  approximately  equal  numbers  of.  males 
and  females  with  low  and  below  average  achievement  were  assigned  to  each 
treatment.  Students  were  directed  to  one  of  five  microcomputer 
stations,  and  the  corresponding  CAI  lesson  was  provided.  Each  student 
received  a  brief  review  of  computer  operation  and  was  instructed  to 
proceed  with  the  lesson.  At  the  conclusion  of  the  lesson  the  elapsed 
time  was  noted  and  the  immediate  posttest  was  administered.  x 

One  week  later  students  were  given  the  parallel  retention  test  in 
their    Classroom.      Only  students  who  were  present  during  all  phases  of 
^the  study  were  retained  for  data  analysis  purposes. 

All  tests  were  scored  using  "blind*1  scoring  procedures  after  the 
delayed  retention  test  was  completed.    Separate  scores  were  obtained  for 
rule  recall  and  rule  application  for  each  test  administration. 
Design  and  Data  Analysis 

This  study  used  a  3  x  2  x  2  between  subject  factorial  design  with 
two  additional  within  Subject  factors.  The  between  subject  factors 
included  three  levels  of  CAI  strategy  (adaptive  control,  learner  control 
with  advisement,  and  no  control),  two  levels  of  achievement  (low  and 
briow  average),  and  sex  of  student.  The  within  subject  factors  included 
test  scale  (rule  recall  and  rule  application)  and  test  interval 
(immediate  and  retention).  $ 
Data  were  collected  for  each  student  on  each  of  the  two  scales,  for 
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both  immediate  and  retention  tests*    In  addition,  time  on  task  data  were 
collected  during  Instruction.    A  learning  efficiency  index,  the  ratio  of 
.  test  score  to  time  on  task,  was  also  computed  and  analyzed. 

Data  were  analyzed  using  MANOVA  procedures  for  repeated  measures 

/ 

designs*  The  MANOVA  procedures  were  used  to  analyze  the  effects  for 
rule  recall  and  rule  application  as  well  as  for  learning  efficiency. 
ANOVA  procedures  were  used  to  examine  effects  for  differences  in  time  on 
task.  Comparisons  among  treatment  means  were  accomplished  using 
Newraan-Keuls  pair vise  contrast  procedures. 
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Results  and  Discussion 
Rule  Recall/Rule  Application  Effect 

The  mean  scores;  for  rule  recall  and  rule  application  scales  for 
immediate  and  delayed  tests  are  contained  in  Table  1,  A  significant 
difference  related  to\  prior  achievement  was  found,  F(l, 34)^16.74, 
j><.0005.  The  below  average  students  consistently  scored  higher  than  low 
students    across    all    CA^  strategies.  In    addition,    a  prior 

achievemenr-by-scale  interaction,  illustrated  in  Figure  1,  was  also 
detected,  F(l ,34)«6,63,  j>4«01»  Below  Average  students  scored  higher 
across  both  the  rule  and  application  scales,  but  proportionately  higher 
on  application  items,  No\dif ferences  were  found  for  CAI  control 
strategy. 


/  \  262 


CAI  Strategies 
12 

As  expected,  a  significant  difference  was  also  found  between  test 
intervals,  F(l, 34)«6.31,  £<.01,  which  was  characterized  by  a  uniform 
decline  in  test  scores  over  time  for  both  treatments  and  scales. 


Insert  Table  1  and  Figure  1  about  here 


Time  on  Task 

A  significant  difference  was  found  for  CAI  strategies, 
F(2,38)=15.80,  £<.001.  The  no  control  strategy  averaged  significantly 
less  time  to  complete  (9.0  minutes)  than  both  the  externally  controlled 
adaptive  strategy  (12.4  minutes),  p_<.05,  and  the  internally  based 
learner  control  with  advisement  strategy  (16.3  minutes),  £<.01.  The 
time  differences  between  the  adaptive  and  advisement  strategies  were 
also  significant,  jK.01. 

A  significant  effect  was  also  detected    for    prior  achievement, 
F(l,  38)»4.88,    j)<.05.    Below  average  students  used  less  time  to  complete 
treatments    (mean    score    »  11.35)  than  low  achievement    students  (mean 
score  =  13.96).  , 
Learning  Efficiency 

The  mean  scores  for  learning  efficiency  are  contained  in  Table  2. 
Several  significant  differences  were  detected.  Learning  efficiency 
differences  were  found  for  CAI  strategy,  F(2f 34)»6.41 ,  j><.005,  and  prior 
achievement,    F( 1 ,3A)-16.22,    £<.00U5.    The  no  control  strategy    was  the 
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most  efficient  (.70  concepts/minute),  followed  by  the  adaptive  strategy 
(.51  concepts/minute),  and  the  learner  control  with  advisement  strategy 
(.36  concepts/minute). 

Although  below  average  students  were  more  efficient  than  low 
students,  a  significant  interaction  also  was  found  between  test  scale 
and  prior  achievement,  F(l ,24)-8.37,  p<.01.  This  effect  is  illustrated 
in  Figure  2.  The  below  average  students  were  more  efficient  than  low 
students  on  both  scales,  but  proportionately  better  on  applications. 

Another  significant  difference  was  evidenced  by  the  interaction 
between  control  strategy  and  test  interval  shown  in  Figure  3, 
F(2,34)»3.64,  £<.05.  The  efficiency  of  the  no  control  strategy 
treatment  dropped  significantly  from  the  immediate  to  the  retention 
test,  while  both  adaptive  and  learner  control  strategy  treatments 
remained  more  consistent  in  their  efficiency.  No  other  significant  main 
effects  or  interactions  were  found. 


Insert  Table  2,  Figure  2,  and  Figure  3  about  here 


General*  Discussion 
Previous  research  has  not  addressed  adequately    the    effects  of 
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various  CAI  control  strategies  on  the  performance  of  low  achievers.  The 
purpose  of  this  study  was  to  examine  the  effects  of  the  locus  of  control 
of  CAI  design  strategies  on  the  mathematics  rule  learning  of  low 
achieving  junior  high  school  students.  The  results  indicated  that  low 
achieving  students  learn  comparably  under  internal,  external*  and  no 
control  strategies,  but  perform  most  efficiently  under  imposed  no 
control  linear  strategies. 

Several  points  warrant  discussion.  The  issue  of  achievement  versus 
efficiency  of  learning  was  a  key  feature  in  this  study.  Whereas  no 
differences  were  found  for  achievement  resulting  from  the  different 
design  strategies,  both  instructional  time  on  task  and  the  associated 
acquisition  rate  were  affected  significantly.  The  adaptive  and 
advisement  CAI  control  strategies  used  in  this  study  required  greater 
learner  time  to  complete,  with  no  associated  gain  in  learning.  The 
basic  linear  design  yielded  comparable  learning  coupled  with 
significantly  less  instructional  time.  Given  these  findings,  a 
convincing  argument  can  be  offered  for  the  functional  superiority  of 
simple  linear  design  models  for  low  achievers. 

In  previous  studies,  reported  by  Tennyson  and  associates,  the 
increase  in  instructional  time  has  proven  worthwhile:  learning  for  older 
and  more  able  students  was  improved  in  direct  telationship  to  the 
control  strategy  and  amount  'of  instructional  time  invested •  The 
patterns    obtained  for  the  younger  and  less  able  learners  in  this  study, 

t 
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however,  may  indicate  that  previous  research  on  instructional  control 
strategies  is  of  limited  generalizability  for  this  population.  Both  the 
age  and1  prior  achievement  characteristics  of  the  present  sample  were 
intentionally  different  from  earlier  studies.  The  age  and  capability 
differences  resulted  in  effects  that  were  clearly  different  from  those 
of  earlier  studies.  ** 
,  Performance  differences  may  be  attributable  to  several  factors. 
Younger  and  less  able  students  have  less  background  knowledge  in  the 
content  area  of  the  instruction,  and  consequently  are  less  effective  in 
making  judgements  as  to  their  progress  and  need  for  addition^ 
instruction.*  This  background  is  required  for  effective  interaction  with 
learner  controlled  strategies.  Strategies  that  continuously  re-route 
learners  through  instruction  that  was  inadequate  in  teaching  concepts 
initially  may  also  be  undesirable.  Low  achievers  may  derive  maximum 
benefit  from  the  initial  presentation  of  instruction,  and  may  experience 
ssonance  upon  le-exposure  to  information  not  learned  initially.  In 
the  present  study,  the  comparable  learning  across  CAI  strategies 
suggests  that  little  was  gained  by  routing  learners  through  either 
internally  governed  or  externally  controlled  options. 

Linear  strategies,  on  the  other  hand,  move  learners  through 
identical  instructional  paths,  based  upon  the  logical  sequence  of 
information,  practice,  and  other  features.  Linear  CAI  requires  neither 
learner    judgement  of  the  need  for  additional  instruction  nor  re-routing 
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through  instruction  that  has  been  ineffective.  Since  low  achievers  are 
more  likely  to  require  the  complete  sequence  of  instruction,  and  are  not 
likely  to  require,  or  profit  from,  the  multiple  options  and  decision 
points  of  more  advanced  learners,  they  may  need  different,  more  basic 
instructional  features.  In  effect,  the  initial  "pass"  through  the 
instruction  may  be  the  most  effective  for  low  achievers,  rendering 
multi-optioned  and  heavily  branched  CAI  of  little  additional  benefit. 
Based  upon  the  findings  of  the  present  study,  simplified  but  powerful 
linear  designs,  that  combine  learning  effectiveness  and  efficiency,  may 
be  the  most  desirable  option  for  low  achievers. 

Of  further  interest  was  the  lack  of  influence  exerted  by  the  CAI 
strategies  compared  with  the  more  powerful  prior  achievement  history  of 
the  learner.  The  test  score  variance-accounted-f or  by  the  different  CAI 
strategies  was  roughly  one  percent*  Prior  achievement,  on  the  other 
hand,  accounted  for  approximately  30  percent  of  the  observed  score 
variance.  Clearly,  the  impact  of  different  control  strategies  in  the 
face  of  prior  learning  was  inconsequential*  Even  if  reliable  learning 
differences  among  control  strategies  could  be  obtained,  it  is  unlikely 
that  such  a  strategy  would  be  substantially  more  efficient  than  a  linear 
strategy. 

In  cases  where  the  information  to  be  learned  is  sufficiently 
important,  the  cost  of  additional  development  and  instructional  time  may 
be    warranted.    Under  most  circumstances,  however,  this  is  not  tfie  case. 
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In  most  public  educational  settings,  for  example,  skills  and  concepts 
are  taught  through  a  variety  of  means.  CAI  is  rarely  used  as  the 
primary  or  sole  instructional  delivery  system,  assuming  instead  a 
^supplementary  function.  It  seems  impractical  to  expect  that  that  the 
significant  additional  expense  of  high  cost,  low  gain  CAI  should  be 
assumed  given  the  relatively  small  increments  such  designs  produce 
versus  simple,  but  powerful,  linear  designs.  The  most  straightforward 
and  inexpensive  design  strategies  will  likely  yield  the  most  efficient 
solutions  for  low  achievers,  and  are  likely  to  be  more  readily  designed, 
produced,  and  installed  into  typical  instructional  settings. 

The  sensitivity  of  the  achievement  classifications  used  in  the 
present  study  to  differences  in  learning  is  also  important.  Several 
effects  involving  the  prior  achievement  levels  of  the  students  were 
obtained,  suggesting  that  considerable  heterogeneity  existed  within 
presumably  "low  level"  tracked  classes.  Educators  have  often  argued 
that  remedial  classes,  such  as  those  used  in  this  study,  provide 
homogeneous  learners  with  respect  to  instructional  style,  skill  levels, 
learning  rate,  and  learning  style.  These  arguments  may  be  weakened  in 
view  of  the  findings  of  this  study.  Even  within  the  restricted  range  of 
test  scores  defined  as  prior  achievement,  the  more  able  learners 
obidined  significantly  higher  rule  recall  scores,  were  quicker  and  more 
efficient  during  acquisition,  and  applied  mathematics  rules  to  numeric 
problems    with    proportionately    greater    accuracy    than    the    very  low 
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achievers.      The  universal  instructional  approach  often  sought  for  low 
achievers  may  be  not  only  impractical .  bet  misleading  as  well. 

The  absence  of  effects  for  sex  of  student  nay  indicate  that  male 
and  female  low  achievers  are  more  similar  than  their  normal  and  high 
achieving  counterparts.  The  male-female  achievement  differences, 
beginning  roughly  at  the  academic  grade  level  of  the  students 
participating  in  the  present  study,  are  well-documented  for  the  general 
population.  For  low  achievers,  however,  gender  does  not  appear  to 
differentiate  the  effectiveness  of  control  strategies,  or  to  affect  the 
magnitude  or  efficiency  of  mathematics  learning. 

The  true  effects  of  varied  CAI  instructional  control  strategies  on 
the    mathematics    rule    learning    of  low       .eving    junior    high  school 
students   may    be  related  more  to  the  efficiency  than  the    magnitude  of 
learning.     The  methods  employed,  and  questions  addressed,  in  this  study 
have    permitted    the  inclusion  of  two  important  practical  ^instructional 
dimensions    not    typically    evaluated:  time  and  efficiency.     These  are 
important  dimensions,  and  represent  a  departure  from  the  manner  in  which 
learning    and  instruction  issues  are  typically  studied.    Perhaps  future 
attempts    to    study  the  effects  of  CAI  and  other  instructional  delivery 
systems    will    move       closer    still  to  the    merging    of    empirical  and 

4 

practical  concerns. 
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Prior  Achievement 


AC 


Rule  Recall 

LC       NC  TOTAL 


Rule  Application 
AC       LC       NC  TOTAL 


Immediate  Test 


Low 


Female 

Male 
Below  Average 

Female 

Male 
Total 

Female 


Male 


6.0  5.3  4.0  5.1 
4.4      4.0     4.5  4.3 


7.8     4.7      5.5  6.1 


6.3      6.5     7.0  6.7 


6.9      5.0     4.9  5.6 


5.1      5.5     6.0  5.6 


7.5  7.3  5.3  6.8 
6.4     6.0     6.0  6.2 


11.3     8.0    10.0  9.9 


8.7     9.3    11.3  10.0 


9.4      7.6     8.0  8.4 


7.3     8.0     9.2  8.2 


detention  Test 


Low 

Female 
Male 

BcIcjw  Average 

Fcir.n  1  »* 

M.ilc 
Tot. u 

i  em«*i  1  b 

Malr 


4.3      4\3      5.0  4.5 


3.8      4.8     4.0  4.2 


'6.3      3.8     5.0  5.0 


6.3      5.8      5.3  5.8 


t    5.3      4.0      5.0  4.8 


4.8      5.'i      5.0  5.0 


8.0     5.8      5.0  6.2 


6.8      5.0      5.0  5.8 


11.7      6.7      7.8  8.6 

9.3    10.0     8.:  9.1 


9.8      6.1      6.6  7.4 


7,8      7.8      7.1  7.5 


Note.    AC  -  Adaptive  Control     LC  -  Learner  Control  with  Advisement 

NC  -  No  Control 
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Mean  Scores  for  Rule  Recall  and  Rule  Application  Learning  Efficiency 


» 


Rule 

Recall 

Rule  Application 
* 

Prior  Achievement 

-AC 

LC 

NC 

TOTAL 

AC 

LC 

NC 

TOTAL 

• 

Immediate  Test 

Low 

> 

♦ 

- 

1 

Female 

.42 

.33 

.50 

.41 

.52 

•45 

.55 

.50 

Male 

.32 

.21, 

,57 

.35 

.49 

.33 

.60 

.47  * 

Below  Average 

• 

• 

Female 

.75 

.29 

.58 

.54 

1.07 

.44 

i.ep 

.'89 

Male 
Total 

.67 

.55 

.94 

.74 

.98 

.82 

1.54 

1.16 

\ 

Female 

.59 

.31 

.55 

.48 

.80 

.45 

.35 

.70 

Male 

.  .45 

.40 

.82 

.56 

.68 

.60 

1 .23 

.84 

Retention 

Test 

Low 

• 

Female- 

.34 

.27 

.63 

.40 

.62 

.38 

.48 

.48  ' 

Male 

.27 

.25 

.46 

.31 

;5i 

.28 

.56 

.44 

Below  Average, 

IVuulc 

.63 

.22 

.51 

.46 

J  .37 

.42 

.80 

.80 

Mali- 

.65 

.48 

.74 

.63 

1  A)2 

,ti0 

1  J  6-  1.00 

Total 

Fenal ? 

.48 

.25 

.56 

.43 

.89 

.40 

.66 

,f4 

Mai* 

.41 

.38 

.65 

.48 

.70 

•  >7 

.96 

.75 
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Figure  Caption 

Figure  1.  Mean  achievement  for  below  average  and  low  students 
on  rule  recall  and  rule  application  tests* 

Figure    2*    Mean  learning  efficiency  for  below  average  and  low 

students  on  rule  recall  and  rule  application  tests. 

/ 

» 

Figure  3.  Mean  achievement  for  no  control,  adaptive,  and 
learner  control  strategies  on  immediate  and  retention  tests. 
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Chapter  1 
Problea 

« 

Legible  text,  whether  proeentod  via  paper  or  Cathode  flay  Tuba 

>    .8  •  ' 

diaplaye  CCRTa  or  VDTe)  poaaaaaaa  thrtt  qualitieet    ayabol  viaibility 
(clarity),  ayabol  recogniiabi.lity  (parcaptabifity) ,  and  ovarall 
coapreheneibility  (readability)  (Reynolde,  1979).    A  legible  diaplay 
coebinee  tha  writing  of  tha  author  with  tha  aeraan  deetgn  akilla  of 
tha  publiaber.    An  author  can  refer  to  tha  rulee  of  graaaar,  apalling 
and,  uaaga  for  aaaiatanca  in  writing  an  undoratandabla  aeeeage. 
However,  tha  publiahor  lacke  tha  aaaa  advantagt  of  foraal  ruloa  or 
guideline*  whan  coabining  tha  text  eleeente  that  praaant  tha  author 'a 
writing,  uaing  inataad  a  coabination  of  artiatic  principlaa, 
folklore,  tradition,  and  aconoaic  rattrictione. 

Art,  tradition,  and  folklore  contribute  to  an  attractive 
layout  which  ia  uaaful  in  gaining  and  keeping  a  reader  *  attention, 
Hovever,  attention  ia  only  one  part  of  the  perceptual  proctaa  in 
learning  froa  inatructional  text.    Jfti-eaer  (1976)  deacribea 
perception  aa  a  cycle  where  the  perceiver  react*  to  the  environaent 
(noainal  atiaulua)  by  eeefcng  out  aeaningful  information  and 
integrating  that  inforaation  into  an  exlating  acheaa.    Written  taxt 
preeented  on  a  CRT  diaplay  ia  a  noainal  atiaulua  where  reading  ia  tha 
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pri««ry  seans  of  acquisition.    Reading,  too,  it  a  continuous  cyclt 
thft  requires  attending  to  a  stiaulus,  encoding  the  stiaulus  in  a 
eeaningful  aanntr,  and  Unking  tht  oeeninos  with  existing  knowledge 

« 

or  prior  experience  (Tinkor  and  HcCullough,  1962). 

Tht  cognitive  link  between  rtading  and  perception  it  iaportant 
becauae  it  defines  a  psychological  am  that  nay  b§  ueed  to  identify 
proctttaa  uitd  by  roadtra  in  parctiving  CRT  ttxt  and,  it  aata  at  a 
design  object ivt  the  accurate  translation  of  a  noainal  stiaulus^into 
an  effective  stioulus.    Text  should  be  foraatted  in  way*  tbit 
facilitate  the  total  perceptual  cycle,  not  just  the  attention 
proceaa.    Research  aiaed  at  oeeting  this  objective  has  centered  on 
the  viaibility  and  re'ognizability  characteristics  of  text. 

Visibility  and  recognizability  contribute  to  awareness  and 

i 

encoding/  Works  by  Tinker  (196*3/  1965)  and  later  updated  by  Rene 
(1979)  cover  the  area  of  visibility  quits  thoroughly.  These 
findings    are  usually  widely  practiced,  since  a  publisher  who  does 
not  produce  visible  aaterials  Mill  not  be  a  publisher  fir  long. 
Although  these  saee  itandards  are  frequently  uted  for  CRT  text 
diaplays,  the  generatizability  of  paper  standardi  to  the  CRT  has  not 
been  verified.    Visibility  and  recognizability  research  specific  to 
the  CRT  has  established  brightness,  contrast,  and  letter  size  as  well 
aa  letter  shape  and  dot  aatrix  size.    (See  Srabinger,  1984  for  a 
suanary  of  theae  findings.) 

Reiearch  aiaed  at  enhancing  the  coeprehenti bi 1 ity  of  a 
docuaent  has  been  dotie  with  directive  cues,  chunking,  organizera,  and 
text  layout.    The  eost' successful  of  this  research  has  been  wi>-h 

r 

directive  cues  finding  tUmi  directive  cues  (e.g.,  underlining. 


italic*,  bold  type)  facilitatt  ctrtain  typea  of  Itarning  undtr  the 
following  conditions!  first,  the  cues  oust  be  systematically  related 
to  desired  outcottt  (Grouse  and  Idsttin,  1972  and  Andtrton  and  Faust, 
1967)i  second,  tht  cuts  aust  bo  utod  sparingly  to  indicate  only  thott 
idtai  which  art  auptrordinat*  (Hartley,  Bartlett,  and  Branthwatte, 
1980|  Bausell  and  Jenkins,  1977) t  and  finally,  tht  cuti  mst  not 
inhibit  or  circutvtnt  tht  dtiirtd  presetting  activitiet  (Anderson  and 
fault,  1967)  by  forcing  txtrantoua  aattrial  to  cotpttt  Kith  ttatntitl 
tattrial  or,  by  ptrnitting  non-com tructi v*  responses.    Research  with 
directive  cuti  in  CRT  difplaya  hat  shown  cuts  art  aott  ustful  in 
•tarch  and  rtcognition  taiki  (Christ,  1975,  1977). 

Other  team  of  changing  tht  foraat  of  tent  to  fttprovt 
coaprthtnaion  or  reading  tpttd  have  not  been  at  successful  at  the  ute 
of  directive  cuet.    Thete  effortt  have  included  breaking  the  ttnttnct 
into  chunkt,  hitrarchical  indtntation,  and  the  ute  of  headingt. 

The  goal  of  chunking  retearch  was  to  facilitate  the 
connection!  of  aeaningt  aaong  wordt  between  the  noainal  etiaulut  and 
the  reader's  tcheta.    A  persistent  problee  of  this  research  was 
deciding  where  to  ijreak  a  sentence  into  thought  units.  Several 
iaplicit  astutptiont  were  aade.    The  was  that  each  sentence  was 

cosposed  of  several  id*  as,  each  of  which  was  processed  in  parts  by 
the  individual     Second,  it  was  assuaed  that  all  readers  chunk  in  the 
saae  way.    There  is  no  evidence  to  support  either  assumption.  Ifc**«s^ 
appears,  then,  that  ordinary  punctuation  supplies  alf  the 
organization  necessary  within  the  sentence.    When  placed  in 
perspective  with  the  nuaber  of  coabinations  of  foraat  variables 
available  the  chunking  change  was  aolecular  while  the  intent  c?f  teat 
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design  »t  whoiistic.    <Stt  Srabingtr,  1984 /or  4  tort  dotal ltd 
trtttatnt  of  chunking  research  and  a  lift  of  portintnt  rtftrtnctf.) 

Tht  inability  of  chunking  tg/have  a  significant  tfftct  on 
rtading  tpttd  or  learning  IteVfofortat  changtt  in  paragraph  ' 
organization.    Tht  objective  of  thit  rtitarch  wat  to  ltt  tht  contours 
of  tht  text  fortat/fndicatt  a  hierarchical  organiiation  of  tht 
information  wiJfcfUn  tht  paragraph  or  tht  paga.    Fraat  and  Schwartz 
(1979)  and/ftartlty  (1980)  suggesttd  that  tht  reader's  rtprtatntation 
(effective  stitulus)  of  the  ttructuct  o*  tht  ttxt  nay  bt  tfdt  tort 
accufatt  and  ef fee lent  if  the  fortat  of  tht  ttxt  (notinal  ititulua) 
alto  represents  that  structure.    Again,  the  intent  Mas  to  sakt  tht 
notinal  ttinulus  look  likt  the  unseen  effective  stitulusf  however, 
neither  researcher  could  reject  the  null  hypothesis. 

A  third  fortat  changt  that  did  prove  tc  facilitate  learning  in 
starch  and  rttritval  tasks  and  cotprthtnsion  was  tht  ust  of 
holdings.    Htadings  ware  useful  written  in  both  stattttnt  or  qutstion 
formt  and  whether  etbtddtd  in  the  tain  body  of  the  text  or  hanging  in 
the  targins  (Hartlty  and  Trutean,  1982|  Hollty,  198!). 

In  sue,  tht  effort  to  take  the  notinal  stitulus  look  likt  an 

.„«„..  .U.u,U  .t  tH.r.  ..Ut.  « 

accurate  picture  of  a  universal  effective  stitulus  to  ititatt.  It 
tay  vary  greatly  frot  individual  to  individual.    Plus,  given  the 
cyclical  nature  of  perception  it  would  sect  reasonable  for  the 
effective  stitulus  to  bt  in  a  statt  of  constant  changt  and 
adjustment*    It  sttts  that  frot  tht  application  of  dirtctive  cues  and 
headings  that  successful  fortat  changes  are  those  that  facilitate  the 
reading  and  perceptual  eyelet.    Headings  and  cues  point  up  specific 
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it tat  of  information  for  additional  proceeeing  by  tht  learner.  Tne 

*  a  <,  / 

foundation  for  a  aat  of  foraat  rulee  aay  ba  found  in  tha  perception 
and  raading  processes  that  Hill  halp  publication  designers  conttruct 
.text  that  wil 1  paternally  aodal  appropriate- cognitive  processes,  or 
•.  ,  .  alloM  tha  Uarnar  to  activata  appropriate  aathodt 
independently"  (Bovy,  1981,  p.  208). 

Brabinger  (1984)  attaaptad  to  link  publication  deaign  rataarch 
to  tha  perceptual  procoaaaa  of  individuait  by  developing  aodala  of 
coaputer-gpnerated  text  with  several  controlled  foraat  variablatt 
leading,  left  and  full  justification,  the  praaenca  of  diractive  cuat, 
tha  uaa  of  hypertext,  paragraph  indication,  and  heading  location.  In 
a  aultidiaentional  icaling  ttudy  uaing  pareaptual  aantiaanta 
axpreaaad  by  paraona  viewing  aodela  of  coaputar-ganarated  taxt  on 
CRT*  throa  diaensione  describing  the  p*. ceiver  preferences  were 
foundt    apaciouaneaa,  organization,  and  etructure.  Spaclouanaaa 
rafera  to  deaignt  with  a  ldt  of  Iwhita  apace  and  opanneaa. 
Organization  refers  detigns  that  looked  to  oe  grouped  or  chunked 
around  ideal.    Finally,  etructure  refera  to  datigna  that  appeared 
hierarchically  structured,  uaing  hypertext,  diractive  cuea,  and 
headings  to  indicate  the  etructure  and  location  «f  4nf creation. 

However,  the  atudy  used  a/»  incoaplete  cyclical  deaign  for  the 
paired-coaparison  task.    Subjects  judged  50%  of  all  the  possible 
pairs  of  the  16  stiauli.    Thia  probably  contributed  to  instability 
and  incrsaaad  atrass  wtthin  the  HDS  aolution.    An  analyais  of~a 
coaplete  atiaulus  saaple  aay  enhance  and  refine  the  dafinitiona  of 
the  diaenaiona. 

■y 
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In  light  of  tbit  analytit,  this  study  propottd  to  idtntHy 

/ 

crittria  uttd  by  ptoplt  ttro  vitw  and  aafca  ptrctptual  Judgtotntt  about 
aedalt  of  cooputor-gontratod  tt«t.  -To  itprova  on  tht  previous  ttudy 
this  study  uttd  a  coaplttt  tat  of  carafully  conttructod  ttiauli  and 
factor  analyaia  ttchniqutt  to  analyst  tht  rttulting  data.    Tht  goal 
Mai  to  idtntify  crittria  uttd  by  rtadtr/ptrctivtrt  to  analyst  tht 
apparant  tf f tcti vtnttt  of  ttvtral  aodalt  of  CRT  tcrttnt  battd  coaaon 
ttxt  fortat  variabltt.    Thttt  crittria  (factors  or  diatntiont)  can, 
in  turn,  be  dtfined  and  tvtntuilly  uttd  11  gtntral  dtiign  variabltt 
rtlattd  to  tht  ptrctptual /rtading  proctti  rathtr  than  tatli,  narrow 
typographical  variabltt. 
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Chapter  2 
Methodology 


Dependent  Variable 

Print  and  CRT  reteerch  hive  concentrated  on  tingle  independent 
variable! (  utually  tiling  reading  tpeed,  recognition,  or  coeprehention 
if  dependent  variable!.    Thit  hat  contributed  to  the  developeent  of 
ttandardt  lor  individual  variables  but  not  to  guideline!  for  the 
coabination  of  tho%e  variablet.    The  ute  of  a  dependent  variable  « 
bated  on  Judgeaentt  or  tentieentT  would  pereit  the  ote~ -of- r 
eultivariate  ttatittica!  technique,  tuch  at  factor  analytit  or 
eultidleentional  tcaling.    The  eain  advantage  of  a  eultivariate 
technique,  tuch  at  the  factor  analytit  technique  uted  in  thit  ttudy, 
it  the  ability  to  exaeine  a  eultidleentional  variable,  tuch  at  text 
foreat  ptrcept^tfn,  with  a  unidiaenf ional  neatureeent.  / 

In  thit  cate,  the  dependent  variable  «at  a  unidieentional 
aeature  called  "ttudy-ability."    •Study-ability"  vat  operational^ 
defined  at  the  rating  attigned  fy  partieipanta  to  eodelt  of 

coeputer-generated  text  beted  on  the  perceived  eate  with  which  a  text 

•  *  ■ 

aodol  could  be  read  and  ttudied  at  i.f  the  eodel  were  actual  text. 
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Tfifit  ratings  wart  than  tubtitttd  to  a  8-todt  factor  analytit  to 
idantify  tht  undtrlying  critaria  that  wart  ua«d  «htn  tha  ptrctivtr 
foratd  a  Judgatnt  ralatad  to  tht  -ttudy-ability"  of  a  taxt  todtl. 
ftettaren  Cuts t loot 

A  ttritt  of  qutttiont  Mart  uttd  ai  a  quids  for  intarprtting 
tht  factor  analytit  data.    Tha  fundantntal  attuaptlon  Mat  that  aona 
undtrlying  factort,  taalltr  in  nuabtr  than  tht  original  itt  of 
variablat,  «at  ratponaiblt  for  tht  covariation  in  tha  variablat. 
Thertfort,  •  prtrtquttitt  for  tha  analytit  *at  that  tha 
uniditant^onal  tcaling  of  ttiauli  raprattnt  a  tultivariata  ipaca, 
ltading  to  tha  quattiom 

1.    Can  tha  tultivariata  concept  of  cotputar-gtntratad  taut 
dtt.  *n  bt  scaltd  by  raadart  on  a  unidittntional  acala  ? 

Afttr  tht  validity  of  uiinq  factor  analyiii  Mai  attablithtd  by  tha 

prtttnit,  of  tig)iificant  factor  loading!  the  factort  or  dittntiona 

Mara  naatd  and  conclutiont  about  thtir  attributaa  drawn.  Tha 

following  qutttiont  ttrvtd  at  a  guidt  for  tht  procttti 

2*    Hon  tany  factort  or  dittntioni  raprattnt  tht  judgtttnti 
txprttitd  by  tht  participant!? 

&i    Hha*  art  tha  dtfinitiont  of  tht  dittntiona? 

«1    tthat  iaplicationa  do  tha  dittntiont^havt  for  dttign  of 
cotputtr-gtnaratad  taxt  prattnttd  on  CRTt? 

Data  Satharing  Nathod 


Satplt  ' 

?it  taapla  Mat  coapottd  of  31  undargraduata  atudant  voluMoart 
froa  tht    Univtrtity  of  Ntbraixa—lincoln  TtaCtri  Colltgt.  j 
Participant!  *ara  Unitad  Stattt  eitiitnt  batwttn  tha  agai  of/20  and 
25.  *   

: 

287  •  ' 

28» 


Stieuli 

Stieuli  we re  64  eodels  o*  coeputer  teat  (tit  Appendix  A) 
designed  to  use  variables  that  have  been  rmircliid  in  both  print  and 
CRT  legibility  research  and  that  art  frequently  uttd  in  teat  disign. 
A  eethod  calltd  notation  (Twyean,  1981)  Mai  utad  to  deeign  the  ttxt 

i 

aodali.  Thif  atthod  presents  contamination  fro*  content  variabltt  by 
using  H"e,  "Ci,  and  "Ip»  to  represent  written  ttxt.  Tha  "X"  it  tht 
batic  graphic  unit  that  atandt  for  typographic  noro  auch  aa  tha  bulk 

qf/the  co  y  on  a  paga.    Tha  "0"  represents  a  priaary  variation  froa 

J 

typographic  nora  including  italics,  all  upper  case,  bold  type, 
color,  headinga,or  reverse  type..    The  "I"  Is  a  tertiary  graphic  unit 

♦ 

used  rarely  to  represent  something  particularly  unique  in  style.  The 
•ajor  benefit  of  the  notation  eethod 

is  that  it  encourages  serious^  ttvinking  about  typographic 
problees  in  conceptual  teres,  and  independently  of 
probleas  associated  with  particular  copy  or  composition 
systees.  (p.  1 1 f ~ 

Twyaan's  standard  aethod  was  altered  slightly  in  this  study. 
Srabinger  U984>  used  the  standard  eethod  of  placing  "X"s  to 
represent  the  body  of  the  text  without  indicating  any  spaces  between 
words.    Spaces  were  used  in  this  study  to  aafce  groups  of  "X's  look 
aore  like  words  in  actual  text.    Coaeente^by  participants  in  the^984 
Srabinger  study  indicated  that  the  solid  block  of  "X"s  eay  have 
looked  too  orderly  and  unrealistic.    The  placing  of  the  spaces  was 
deteraintd  by  taking  a  piece  of  actual  newspaper  text  and  copying  it 
using  only  "X"s  and  spaces.  «  

the  stieuli  were  designed 'to  reflect  conbinations  of  -six 

- 

toraat  variables  used  frequently  in -publication  design  Csee  TabU 
t)i    leading,  directive  cues,  paragraph  indications,  hypertext, 
position  of  headings,  and  line  length..  r 
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Tablt  1 

Variab.      Uttd  in  Stimuli  Dtsign 


Ltadingt    (SS)  tinglt  spacing 

(DS)  doublt  spacing 

Dirtctivt  Cutts    <NDC)  no  dirtctivt  cuts  prtttnt 

(DC)  dirtctivt  cuts  prtttnt 

Paragraph  Indication!    (IP)  indtnttd  paragraph 

(SP)  tpactd  paragraph 

Hyptrttxtt    (NHT)  no  hyptrttxt  prtftnt 

(HT)  hvptrtaxt  prtftnt 

Htading  Potittont    (EH)  tabtddtd  htadingt 

(IH)  itolattd  htadingt 

Lint  Ltngthi    fLL)  long  (60  characttr)  lint 

(St)  thort  (40  characttr)  lint 


Loading  (tpact  bttwtan  lintt  of  ttxt)  had  two  valuttt 
finglt  spacing  (SS)  and  doublt  tpacing  (DS).    Kolart,  Duchincky,  and 
Ferguton  (1981)  found  that  doublt  tpacing  bttwttn  lintt  of  ttxt  on  a 
CRT  Marginally  incrtattd  rtading  spttd  ovtr  tinglt  tpacing.  Howtvtr, 
thty  alto  found  that  r9*4inq  tinglt  tpactd  ttxt  rtguirtd  Ittt  occular 
tffort,  btcautt  tort  dtnttly  packed  ttxt  rtquirtt  ttalltr  and  f tttr  - 
tyt  tutclt  aovtatntf.    Brabingtr  (1984)  found  that  ptrctivtrt 
prtftrrtd  doublt  tpactd  ttxt.    Howtvtr,  this  prtftrtnct  it  not  cltar 
cut  and  inttractt  with  lint  ltngth.    Rtadtrt  often  do  net  tind' thort 
lintt  of  tinglt-tpactd  ttxt  (Tinktr,  1962).    Thtrtfort,  tht  afftct  of 
tinglt  vs,  doublt  tpactd  ttxt  wat  tttttd  with  both  thort  and  long 
1 intt. 
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Lint  length  w«s  another  virion.    Turnbull  and  Beird  (1964) 
rtcoaaend  that  linn  of  text  bt  bttwtsn  ont  elphabtt  and  two  and 
ont-half  alphabet!  long.    In  other  words,  a  lint  should  bt  about  26 
to  63  characttrt  long  for  a  given  ttylt  and  site.    Research  by  Keenan 
(1981)  supports  thit.    Kttnan  uatd  a  cotputtr  to  dtttraint  tht 
optiaal  lint  Itngth  in  ttrta  of  "chunks"  (eeaningfui  phrast  units  for 
difftrtnt  readability  lavtls.    Rtsults  indicattd  that  lint  ltngths  in 
tht  vicinity  of  45  to  55  characttrs  bast  Maintain  tht  integrity  of 
tht  grtattst  nuabtr  of  idea  units.    Yat,  daspitt  this  rastarch 
dtsigntrs  ofttn  persist  in  long  linas  of  ttxt.    Ttxt  prtstnttd  on  tht 
CRT  screen  can  ba  aada  up  to  80  characters  long.    Therefore,  tht  two 
conditions  in  this  study  Mtrt  sat  at  60  (LI)  and  40  (SL)  character 
lines.    Both  fall  within  acceptable  standarde,  yet  are  eaaily 
discriainated  froa  one  another. 

Directive  cues  took  on  two  values:    either  the  cues  cere 
present  (DC)  or  not  present  (NDC).    Srabinger  (1984)  found  that  the 
presence  or  absence  of  directive  cues  had  no  affect  on  prefe?HTCes 
expressed  by  participanta.    However,  directive  cues  have  proved  a 
useful  foraat  device  when  used  sparingly  and  related  to  desired 
outcoaes.    Therefore,  cues  were  added  to  the  stiauli  by  shading  three 
selected  "words"  with  lines. 

Paragraph  indication  was  *  fourth  variable.  Paragraph! 
were  indicated  by  the  use  of  increased  white  space  (SP)  (double  or 
triple  spacing  between  paragraphs)  or  traditional  indentation  (IP). 
Subjects  in  the  Srabinger  1984  itudv  stated  that  they  preferred  the 
increaaed  space  aethod  of  paragraph  indication  because,  the  screen 
appeared  tore  structurrd  and  organized. 
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Hypertext  was  «  fifth  variable  indicated  by  itt  presence 
<HT)  or  iti  absence  (NHT).    Heines  (1984)  recoettnds  tht  use  of 
hypertext  to  htlp  kttp  rtadtrt  appristd  of  thtir  location  in  a 
lttson,  tht  Itsson  content,  thtir  progrttt,  and  ttttntial  coaputtr 
cottanda  (e.g.,  forward,  back,  or  exit).    Hyptrttxt  it  rtcoaatndtd 
btcautt  CRT  ttxt  pages  art  short,  change  Irtqutntly,  and  tht  naturt 
of  a  CAI  lotion  oftsfn  prevents  easily  flipping  ahtad  or  backward. 

Htading  location  was  tht  sixth  variablt  used.    Htadingt  were 
eithar  atbtddtd  in  tht  ttxt  (EH)  or  itolattd  in  a  separate  coluan 
(IH).    Tht  u«t  of  htadinga,  particularly  in  quaition  fora,  has 

r 

facilitattd  ltarning  (Hartlty  and  Trueean,  1982).    Tht  location  of 
tht  headings  aay  affect  tht  apptaranct  of  organization  and  structure 
of  the  page  (Grabinger,  1984). 

Tht  2  X  2  X  2  X  2  X  2  X  2  design  presented  64  possible 
stieulus  scrttn  design  combinations.    Each  page  Mas  designed  on  an 
IBM  PC  computer  with  the  Hultieate  word  processor  prograa.  Tht 
stmuli  pages  were  printed  on  a  dot-eatrix  printer  and  then  enlarged 
on  a  photocopy  eachine.    The  enlarged  copies  tore  closely  reseebled 
the  fize  of  a  typical  CRT  screen.    After  enlargement  the  stiauli  were 
laainated  for  durability. 
Procedures 

1.  Subject!  were  wtlcoaed  to  the  experiment  and  asked  to  sit  in  a 
chair  at  a  table. 

2.  The  instructions  for  the  procedure  (see  Appendix  8)  were  then 
played  on  a  cassette  recorder  and  any  questions  were  answered. 
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Subject!  thon  performed  the  0-8ort  procedure.    They  wtrt  asked;  to 
fort  the  stieuli  into  seven  pilot  According  to  tht 
•study-ability'  factor  described  in  tht  inttructiom .  Four 
itiauli  Ntro  plactd  in  Pilo  1,  8  in  Pilo  2,  12  in  Pile  3,  16  in 
Pilt  4,  12  in  Pilo  5,  8  in  Pilo  6,  and  4  iff  Pilo  7.  This 
arrangement  approximated  a  noroal  distribution,    Tht  Srabingor 
(1984)  ttudv  found  that  only  a  fan  of  tht  tixtton  atiouii  uatd 
tlicittd  strong  feelings,  Mhile  oott  Mere  of  neutral  naturt. 
Thit  ttudy,  than  assuoed  that  tha  coopltta  ttt  of  ttiouli  Mould 
approxioate  •  noroal  distribution,  with  ftw  tliciting  strong 
feelings. 

Afttr  cooplotion  of  tht  torting  task  tha  participant  Mas 
inttrvitMtd  about  tht  crittria  ustd  during  tht  task.  Responses 
Ntrt  Mritttn  dOMn  by  tha  axptriotnttr.    Participants  Mara  shoMn 
tha  first  pilt  and  asked,  "Hhy  did  you  rata  those  tha  hightst  on 
tht  "study-ability"  factor?"    Than,  thty  Mtrt  shown  thtir  savtnth 
pile  and  asked,  "Mhy  did  you  rate  these  the  lowest?" 
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Chtpttr  3" 
ftttultt 

Tht  txptrittnt  productd  one  group  of  data  which  Nat  analyztd  by 
factor  analytit  ttchnigutt  and  a  tix-way  analytit*  of  varlanet.  Tht 
factor  analytit  productd  thrtt-  significant  diatntiont  or  factort 
tabltd  tpacioutnttt,  ttructurt*  and  tiaplicity.    Tht  rttultt  of  tht 
ANOVA  Ntrt  uttd  to  help  inttrprtt  tht  ataning  of  tht  factort 
diicovartd  in  tht  factor  analytit. 

0 

Data  Analytit  Proctdurtt 

Tht  factor  analytit  proctdurtt  uitd  wtrt  alpha  factoring 
technique  frot  3P38X  (SPSSX,  1983)  for  a  Q-todt  factor 
analytit.    Tht  analytit  procttdtd  in  4  ttagtti 

Firtt,  a  data  filt  tat  prtpartd  for  tht  alpha  factor  analytit 
and  tht  ANOVA.    A  31  X  64  call  data  tatrix  of  tubjtcjt  ratings  of  tach 
•tiau'lut,  with  tht  itituli  attigntd  to  rows  tat  prtpartd  ft.*  th* 
factor  analytit.    A  ttcond  tatrix  with  tht  tubjtctt  attigntd  to  rowt 
Mat  dtvtloptd  for  a  rtptattd  ttaturtt  ANOVA. 

Stcond,  tht  alpha  factor  analytit  Nat  ptrforttd  tith  Variaax 
rotation.    Alpha  factor  analytit  tat  chottn  btcautt  it  aaxitirtt  tht 
tiaiUrtty  aaong  titilar  thinking  tubjtctt  (Nit,  tt.  ai,  1979). 
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Third,  *  *  let  or  array  proctdurt  tiling  a  eotputar  prograt 
tritttn  by  Kraatr  and  Aaadto  (1984)  «at  ptrfOratd  uting  the  factor 
loading!  frot  each  tubtat  of  aubjtctt  that  load  highly  on  tach  aain 
factor.    Thi*  proctdurt  trantforatd  tht  ran  acortt  of  tha  atiauli  to 
•cortt  rtprtttnttng  tht  aagnitudt  of  tht  factor  loading*  for  aubjtctt 
loading  highly  on  that  factor.    Tht  tranafprotd  acortt  of  tht  atituii 
Mtrt  thtn,uatd  to  tort  tht  atituii  according  tht  tatt  tcalt  uaad  by 
tht  aubjtctt  initially. 

Fourth,  a  tin-way,  rtptattd  ataturtt  analyaia  of  varianca  «aa 

w 

ptrforatd  on  tht  data  tiling  tht  BMP  U981)  ttatittical  packagt. 
Data  frot  tht  ANOVA  wtrt  uatd  to  aid  in  tht  inttrprttatibn  of  tht 
dittntiont. 

Thit  deaign  providtd  output  that  ptrtittd  ditcuttion  about  tht 
folloMingi 

1.  Tht  Q-oodt  factor  analyaia  yitldt  actual  groupt  of  litilar 
thinking  individualai 

2.  tht  factor  array  proctdurtf  providt  a  Q-aort,  or  ptrctption,  of 
tht  ttituli  attociattd  with  tvtry  tignificant  factor  dtrivtd  frot 
tha  factor  analyaiat 

3.  *  coap»rifon  of  difftrtnt  group  ptrctptiont  bastd  on  tha 
difftrtneta  in  tht  factor  array*,  or,  in  afftct,  difftrtnea*  in 
tht  ptrctptiont  of  tht  todtl  ttxt  dtaignai 

4.  and    a  picturt  of  tht  itportanct  of  tht  variabit*  via  tht. 
analyaia  of  varianct. 


Factor  Analysis  lot ut ion 

Tht  data  aatrix  subsittad  for  analysis  containad  tha  pi  1 • 
nuabtr  in  which  tach  subjtct  placad  tht  tptcific  ttiaulus.    Tht  alpha 
analytit  calculated  a  correlation  oatrix  bttnttn  all  piirt  of 
subjtct-sorts  and  than  ptrforaed  a  0-aodt  factor  analysis  to  txtract 
group*  containing  subjects  that  covariad  because  of  siailar  Q-sortt 
Urft  Tablt  2).    Tht  Q-eode  factor  analysts  it  designed  to  isolate 
distinctive  groups,  if  tuch  grouptexist.    Sinct  every  Q-sort 
raprtttnttd  •  "study-ability"  vaiua  parcaption  ovar  tht  64  text 
aodait,  a  covarianct  of  Q-sorts  it  a  covariance  of  sioilar 
ptrctptiont.    Each  significant  Q-aoda  factor  should*  than,  rtprtsant 
a  prototypical  "study-ability"  parcaption,  rtfltcting  tha  coaaon  but 
not  tha  uniqua  portions  of  tha  parctptions  of  thost  lubjects  who  load 
highly  on  i t. 

Tht  rtsults  of  tht  rotatad  factor  analysis  ara  prtaantad  in 
Table  2  (next  pagt).    Significant  factors  stltcttd  for  analysis  wars 
Factors  1,  2,  and  3.    Factors  4,  5,  and  6  wart  not  considered 
significant  bacausa  of  tht  taall  nuabtr  of  subjects  loading 
significantly  (aort  than  .9  variance!  on  thost  factors. 
Factor  Array  Proctdurt 

To  dtfint  tht  factors  it  was  ntctstary  to  take  tht  additional 

stop  of  crtating  factor  arrays  for  tach  Q-aoda  factor  derived  in  tht 

> 

analysis  and  considtrtd  to  bt  significant.    Taking  this  additional 
stap  ptraitttd  tht  ditcuttion  of  tht  distinctivt  typts  of  ttxt  dtsign 
ptrctptions  that  potentially  exist  in  tht  population. 

Tha  proctss  of  arriving  at  a  8-sort  for  a  factor  or  group 
is  analogous  to  a  subjact's  task  of  ttntrlly  assigning  values  to  taxt 
aodals  and  than  discriaioating  aaong  tht  valutd  ttxt  oodtls  by 
sorting.    Tht  rttult  it  a  group  8-tort  instead  of  a  tinglt  subject 
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TtbU  3 
Factor  Arrays 


\ 


Factor  1 


2  17  20  21 


5    6-  8  10  1    7  12  14  4  13  16  23  3    9  32  36    11  25  27  35    43  Si  59  63 

19  22  26  50  15  10  24  28  29  31  33  37  42  44  46  47    41  45  57  64 

.  30^34  40  52  38  39  53  54  4t>  49  60  61 

,  55  56  58  62  *       .  , 


Factor  2 


7 


1  37  39  47 


3'  6  15  17 
18  26  36  62 


5  12  13  14 
21  28  30  38 
41  46  S3  64 


4    8  10  11 

19  20  24  29 

31  33  42  43 

SI  35  56  59 


7  22  27  32 
40  44  48  50 
54  60  61  63 


2  9  25  34 
35  45  52  SB 


16  23  49  57 


Factor  3 


13  38  41  53 


1  3  5  18 
19  26  28  46 


2  4  12  14 
20  21  37  39 
45  47  52  62 


6  8  10  11 
IS  24  25  29 
30  33  44  51 
54  56  59  64 


9  16  17  22 
23  31  36  40 
42  49  60  61 


7  32  43  48 
55  3?  58  63 


27  34  33  50 


<r-e? 
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Tab It  4  % 
Repeated  Meaauret  Analygi*  of  Variance 


Rain  Effect*  <p  < 

.01) 

Sua  of 

Degree*  of 

Htan 

Source 

Square* 

Frttdot 

Square 

"  F 

Reen 

31720,00454 

1 

31720.00454 

6992498.00' 

Error  «• 

.13609 

30 

.00454 

Hypertext  " 

373.44f70 

1 

373.64970 

21.42* 

Error 

523.30343 

,30 

17.44345 

Hoadinge 

.84728 

1 

.84728 

.07 

Error 

347.66835 

50  , 

11.58894 

« 

Oirtctiva  Cutfl 

236.30454 

1 

236.50454 

15.28* 

Error 

464.44859 

30 

15.48162 

Spacing 

..  64.23841 

1  . 

64.23841 

4.30 

Error 

428.65222 

„  30 

14.28841 

%7.35* 

Lint  Length 

237.88760 

1 

237.887,60 

Error 

259.00302 

30 

8.63343 

Paragraph 

136.81502 

1 

136.81302 

18.82* 

•Error 

216.13810 

30 

7.27127 

•p  <  .01 
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tort  uting  high-loading  individual!.    Thut,  the  calculation  of  tha 
factor'!  pirctivtd  "ttudy-abi lity"  valuta  for  ill  of  tha  text  aodele 
dtptndt  on  tha  prior  acorta  aaaigntd  to  text  aodtlt  by  thtaa 
high-loading'indtvidiuala.    The  factor  amy*  art  prtttnttd  in  tablt 

AN0VA 

«  Tht  tix-Nay  repeated  eeaeures  analyti*  of  variance  «*e 

* 

perforeed  to  heip'ahed.  light  on* tht  factor  anlyaie  inforoation.  Tht 

a 

AN0VA  prtaented  difference!  aaong  four  of  tht  aix  tain  eff octet 
hypertext    dirtctivt  cute,  line  .length,' «nd  paragraph  tpacing  (eat 
Table  4).    CRT  ecreen  aodele  with  hypertext,  directive  cue*,  et.ort 
line*  and,  apactd  paragraph*  tare  rattd  hightr  than  aodel a  without  ' 
hypertext  op  directive  cue*  ant*  with  long  lint*  and  ineented 
paragraph*. 
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Factor  Oaf 1 nit ions  » 

f  - 

£t£tfir.JU    Tin  participant!  had  high  loadings  on  this  factor, 
oi  ton  participants  ustd  sitilar  crittria  «han  sorting  tht  64  tout 
aodals.  ^n  tht  batit  af  tht  torttd  stiouli,  iubjtct  inttrvitttf,  and 
ANOVA  this  factor  is  lablad  structurt.    ^s  praftrraji  stiauli 
appiartd  tort  structurtd,  that  is,  organized  and  hierarchically 
arranged  than  tht  lot  rate*  streuli .    Tht  four  highly  rattd  stiauli 
(Broup  1)  had  hypertext  Mhilt  tht  four  Ion  rattd  ttii  uli* (Sroup  7) 
did  not  havt  (stt  Appendix  A  for  tha  Group  i  and  Broup  7  stiauli  in 
aach  of  tha  thrtt  factors).    This  is  consistant  with  information  in 
tha  ANOVA  tthara  tha  hypertext  condition  was  rated-hiflher  than  tha 
no-hypertaxt  condition.    Also,  all  four  of  tha  high  rated  aodals  had 

/ ' 

tha  diractiva  cuas  option,  while  thrtt  of  tha  Ion  rattd* aodals  did 
not  havt  diractiva  cuaa.    This  alto,  is  consistant /with  tha  ANfUfA 
results.    Tha  paragraph  condition  aay  havt  contributed  to  tht. 

appaaranct  of  structura,  too.    Thraa  of  tha  highly  rattd  aodals  Mara 

o 

tha  spactd  paragraph  condition,  Mhiie  all  four  of  tha  Iom  ratad 
ttiaull  Mart  tha  indented  paragraph  condition.  /  Th#  condition  of 

structura  suggasts  that  tha  high  rattd  stiauli 'appear  organized  Mith 

'    '     /  ' 

dearly  aarktd  ssgaenta  of  inforoation,  ytt  ralatad  to  a  aajor  topic. 

£l£i9X.2j.    Tha  highly  r,at'ed  ttituli  in  Group  1,  sorted  on 
Factor  2  ssat  to  bt  characterized  by  their  ti-apiicitv.    Thraa  of  tha 
top  four  art  doublt  spactd  with  no  coaplexitiot  introduced  'frot^the 
presence  of  hypertext,  itolattd  headings*  or  spacad  paragraphs.  All 

7  /  ' 

appaar  aaay  to  raad  froa  top  to  bottoa  and  aora  unjfied  for  a  siapla 
raading  task.    Tht  four  todtls  froa  Broup  7  art  aadr  aora  coaplex  and 
lgsf  unifiad  by  tht  ust  of  hypertext,  isolattd  headings,  or  both. 
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i  ■ 

Theee  four  atiauli  lack  the  appearance  of  etructurafdeicribed  in 
Factor  I  and  alto  appear  tcattered  and  lata  aaay  to  read,  tfioplicity 
of  detignwat  a  eignificant  critaria  for  e4x  aubjacta  who  loaded 
highly  on  Factor  2,  . 

Elitfif._Ja.Tha  dietihguithing  cheracterietic  between  the 
atiauli  in  Broup  t  and  8roup  7  aataa  to  ba  ipaciouinett  for  tho  tix 
aubjacta  who  loaded  highly  on  factor  3.    Three  of  tha  four  highly  , 
rated  atiauli.  ara  double  apacad  wijth  abort  lines,'  athilt  all  four  of 
tha  lowly  ratad  atiauli . ara  .aingla  apacad  and  appaar  Jaaaad-up  with 

'text*   Although  tha  ANOVA  indicated  no  aaln^effect  difference  between 
tha  tingle^and  double  tpac«d~aodeli>  aa  a.wholp,  thfi  aubgroup  of 

'participant!  thought  that  thia  wae  important.    Thia  ia  conaietent  - 

with  tubject* interviewe  wher.t  9  of  tha  aubjacta  atated  that  their 

*  •  . 

4 

_eain  criteria  wae  double  apacing"  within  the  text. 
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Chtpttr  4 


Diecuesion 


The  uft  of  aultivariett  technique*  in  ttxt  dttign  and  visual 


problee*  can  provide  a  Qrtat  dtal  of  data  (ate  alto  Grabinger,  1984 


nature  of  perctption  tht  huaan  being  it  adaptivt.    Huaant  can  rtad 


graphic  coebinatione.    Difficultitt  in  rtading,  ttarching,  or 
coeprehention  tatkt  occur  at  extreaet,  tuch  at  very  taall  or  very 
large  type  tizt,  tuggettinq  that  thtre  are  eany  coabinationt  of  ttxt 
dtaign  variabltt  that  tay  be  contidtrtd  opUeal.    Ttchniqutt  tuch  at 
factor  analytii  and  eultidiatntional  acaling  provide  i  batit  for 
identifying  perceptual  tendenciet  or  patttrnt  that  tuggett  gidtlinet 
for  the  coabinationt  of  text  dttign  variabltt. 

The  original  problee-of  thit  ttudy  wat  to  idtntify  perctptual 
judgeaentt  exprttttd  by  ptrtont  viewing  todelt  of  coepuier-generated 
text.    The  coebinationt  of  aix  CRT  dttign  variabltt,  each  with  two 


valuei,  teeaed  to  affect  three  criteria  uttd  by  participant!  in 
taking  judgtteattf    ttructure,  titplicity,  and  ipacioutnttt.  Mhile 
contciout  of  each  thingt  at  the  prtttnct  or  abttnct  of  directivt 


eatily  a  widt  v;  i  « 


:y  of  typt  ttyltt,  typt  siztt,  line  lengtht,  and 
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cuts,  tht  length  of  tht  lints,  and  doublt  or  tingle  spacing,  tht 
participant!  Mtrt  guidtd  in  thtir  judgtatntt  by  tht  overall 
structure,  tiaplicity,  and  spaciousness  of  tht  documents. 

0 

Tht  first  crittria  diicutud  Mat  ttructurt.    This  dimension  Mat 
also  found  in  tht  1984  aultidiatnsional  scaling  study  (6rabinger). 
Structurt  rtftrs  to  designs  that  indicatt  a  hitrarchical  arrangtttnt 
of  subjtct  aattrial  organiitd  with  tnt  ust  of  hypertext,  isolated 
headings,  spactd  paragraphs,  and  dirtctivt  cuts.    Participants  stattd 
that  thty  Mould  prtftr  to  study  froa  text  that  appears  chunktd  into 
aanageable  and  organiztd  stgttnts. 

Tht  stcond  crittria  Mas  tht  siaplicity  of  a  design.    If  tht 
design  did  not  apptar  ntatly  structured  tht  participants  prtftrrtd  a 
dtsign  Mith  ftM  coaplications.    It  would  seen  to  suggtst  that  if  tht 
design  dots  not  apptar  structured  around  its  subjtct  tatttr  tht 
rtader  Mould  prtftr  siaplt  lints  of  ttxt.    No  structurt  Mould  bt 
bttttr  than  a  atssy  or  busy  scrttn. 

Tht  third  crittria  Mas  spaciousntss.    Nhilt  a  cartful  and  ntat 
structurt  can  utilize  single  spaced  type  and  long  lines,  lack  of 
structure  Mill  cause  a  screen  design  Mith  single  spaced  type  and  long 
lints  to  be  rejtcttd.    Yet,  given  lack  of  structurt,  then  doublt 
spacing  is  an  important  crittria.    A  scrttn  of  infornation  should  bt 
doublt  spaced,  preferably  Mith  short  US  character)  lints  if  no  othtr 
graphic  or  dtsign  ftaturts  art  ustd  to  htlp  break  the  text  into 
aanagtablt  chunks  of  inforaation. 

While  tht  ust  of  tul.itivariatt  ttchniqutt  of  for  grtater 
sophistication  in  the  exploration  of  coapltxt  topics  such  ae  text 
design, ;thty  also  rtquirt  a  grtat  dtal  of  data  colltetion.  Although 
this  study  rtatditd  a  fault  of  %  prtvi^us  study  by  tht  ust  of  a 
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coaplatt  stttuius  aanplt,  thtrt  Mt  •till  tha  nttd  for  tort 

information.    A  conttnt  analysis  of  participant  descriptions  of  tht 
atiauli  aa  tall  at  an  tdjactivt  rating  of  tha  atiauli  could 
facilitate  intarpratation  of  tht  factora.    Mhilt  two  of  tht  factort 
(structurt  and  apaciouanttt)  «trt  consisttnt  with  tha  factora 
discovortd  in  tht  1984  Brabinger  atudy,  ont  of  tht  factora  waa 
different.    In  tht  1984  atudy  tht  third  factor  waa  dtscrtbad  aa 
organization,  whertat  in  thia  atudy  tht  factor  waa  daacribad  aa 
aiaplicity.    It  ia  concaivable  that  ntithtr  it  an  accuratt 
dtacription  and  a  aiailar  atudy  using  adjtctivt  actios,  conttnt 
analysis,  and  structurtd  inttrvitwt  aay  htlp  U-rify  or  tliftinata 
that  diaenaion. 
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'  Appendix  •  % 

Inotructlone  te  flubjepte  * 

*  •  " 

Vou  iiill  exeat ne  eeveral  oodele  of  coeputor-genorated  tot.  Theee 
•rt  oodele  of  toit  toot  oay  bo  eeeh  on  cooputer  tetavUlon  ocreeno 
when  uelng  ceoputer-aeeleted  inotrection. 

before  yoi>  begin,  look  at  toot  of  the  text  oodflf  In'  frqnt  of 
you.    Noti  thai  they  are  coopoeed  of  "K"e  and  "0"e.   Tbt  "I"e 
reproeont  the  body  of  tbo  text.    The  "0"e  repreeent  worde  that  art 
epeclcl,  ouch  at  headlnge'or  eubhecdlnge.    On  aeao0of  tbo  aodota  you 
will  too  throe  fete  of  "K'e  that  are  darker  than  the  root  ef  the 
text.   Theee  dark  eete  of  "I"e  repreeent  warde  that  oay  be  In 
lti!tct«  botd  type,  or  underlined.    Finally,  tone  of  the  eodel a  nave 
a  box  at  the  top  of  the  page.    Thin  bote  ia  called  hypertext  and 
containo  a  eboeary  of  the  content  of  the  lecfon  and  a  lift  of 
coaputer  eooOanda  that  oay  help  the  learner  dor lag  the  leeeo'n. 

Nhon  you  exaoine  the  text  eodelf  evaluate  edch  oedol  on  a 
factor  called  "etudy-ebility."   "Study-ability"  refere  to  both 
t.  readability  and  learning  cherccterlotice.   for  eaaeple,  a  text  eodel 
with  a  high  "atudy-ability*  factor  would  appear  eaey  to  read  and  eeey# 
to  atudy.    On  the  other  hand,  a  text  node!  with  a  loo  "etudy-ebMity" 
.factor  Mould  appear  hard  to  road  and  hard  to  atudy.    You- art  the  / 
judge  of  what  appeare  eaey  or  hard  te  read  and  atudy.    There  la  no 
right. or  wrong  eneuer.    The  beet  anfwer  la  whatever  you  decide. •  Look 
at  each  oodel  and  aak  youraelf,  "If  thie  were  actual  toxt  would  I 
find  thla  ptyle  eaey  to  read  and4  atudy  or  hard  to  read  and  atudy?" 

Sort  the  64  eodel e  of  coeputer-generated  text  into  aeven  pi lee 
according  to  the  "etudy-abillty"  factor.    Reoaeber  to  ttaae  your 
judgeoentf  On  hoe  eaey  the  oodel  appear a  to  atudy  aa  if  the  oodel 
were  actual  text.    Uae  the  eortlng  procedure  deecrlbed  ae  folleuai 
In  Pile  no..  1,  place  the  4  text  oodele  that  have  the  hlgheat 
"etudy-abllity"  factor.    In  Pile  No.  7,  place  the  4  text  oodele  that  • 
have  tfto  loooet  "etudy-ebility"  factor.    One  nay  to  do  thla  la  to  go 
through  the  text  oodele  carting  thee  into  high,  eedlso,  and  loo 
"study-ability"  pi  lee.    Then  return  to  thi  "nig*"  pile  and  find  the 
four  with  the  higheet  "atudy-abillty"  rating  and  place  thee  in  Pile 
No.  I.   Then,  go  te  the  "loo"  pile  and  find  the  four  with  the  1 oaf at 
•etudy-ability"  rating  and  place,  thee  In  Pile  No.  7.  * 

After  placing  oodele  in  pile  nuobera  1  and  7  there  will  be  96 
oodele  left.    Place  all  of  the  oodele  together  and  repeat  the  porting 
procedure.    Place  the  8  with  the  higheet  "atudy-ability".  rating  in 
Pile  No.  2  and  the  8  with  the  lowfot  "atudy-ability"  rating  in  Pile 
No.  6. 

Then  there  will- be  40  text  oodele  reeaiaiog.   Place  ail  Of  the 
oodele  together  again  and  re-eert  then.   Pro*  theee  40  eodel a  place 
the  12  with  higheet  "atudy-ability"  rating  in  Pile  No.  3  and  the  12 
with  loweat  ratine  in  Pile  No.  9.  . 
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36 

Thtrt  Hill  than  bt  16  aodoia  laft  and  thny  art  ail  placid  In 
Flit  No.  4. 

o        Tfti  ouaba*  of  tha  tint  oodota  to  ba  placid  in  oacfr  pile  ttao 
aopeara  on  tfio  pi  la  identification  carda  on  the  tabla  in  front  .of 
you.    you  oay  rearrange  tha  node!*  until  you  ara  eatiefiad  eith  thiir 
placeoent,  but  eake  aura  you  place  tha  apaciliad  nuabar  of  taut 
aodola  In  each  pit a*  c 

you  oay  refer  to  theee  inatructiona  or  aak  tba  eaperiaenter  far 
halp  whenever  you  aieh.  Finally,  raoaabar  to  judge  aacn  eodel  on  ho* 
aaay  it  appaara  to  atudy  aa  if  it  vara  actual  tent. 
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Drill  Sargent  or  Math 'Teacher 
Teacher  Socialization  and  Computer  Advertisements 

Mary  Qribble 
Diane  Gamsky 
Robert  Muffdletto  PhD. 

This  theoretical  paper  addresses  the  question  of  teacher 
socialisation  through  contrived  images;  more  precisely,  the  influence 

» 

of  advertising  as  part  of  an  educational  and  socialization  process.  It 
will  examine  how- computer  advertisements  directed  towards  teachers 
influence  their  perceptions  of  how  computers  can  and  should  be  used, 
and  how  the  same  advertisements  help  dictate  the  types  of  computer 
instruction  in  use  in  the  schools  today.  ■ 

The  goal  of  advertising  is  to  motivate  behavior — to  sell  a 
product,  service  or  idea.     To  accomplish  these  goals  it  is  important 
to  have  ah  understanding  of  the  psychological  and  social  forces  that 
influence  human  behavior.     This  paper  focuses  on  the  consideration  of 

these  forces  in  conjuction  with  advertising's  deliberate  image-making 

i 

with  ths  intenjfr  to  sell. 

Teachers  must  make  rational  choices  concerning  the  use  of 
computers,   (or  the  decision  not  to  use  them).     "Most  researchers  would 
agrta  that  consumers  tin  this  case  teachers)  use  advertising  as  a 
prime  source  of  information  and  that  they  use  it  as  a  time-saving  way 
to  help  them  make  product  decisions.**  (Holtje,  1978)     With  this  in 

i 

mind,  computer  companies  go  to  great  lengths  to  supply 
teachers/consumers  with  the  best  attention  getting  ads  and  sales 

campaigns  with  the  intent  to  sell  their  products.     It  is  in  this  way 
that  computer  advertising  plays  a  crucial  role  in  the  dissemination  of 
information,  and  thus  helps  teachers  make  rational  choices  about  the 
product  they  wish  to  purchase. 
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The  institutional  definition  of  ad  vert  i  si  ng  is>  "Jhe  presentation 
and  promotion  of  ideas,  goods,  or  services  by  an  i dent if ied  sponaor • 
At  one  time,  manufacturers  would  develop  products  and  then  try  to  sell 
them;  it  was  a  cart-bef ore-the-horse  situation,  in  which  the  needs  of 
the  consumers  were  seldom  considered.   ...Modern  marketing,  is 
consumer-oriented."   <Holtje,   1978)     Today,  the  target  group,  defines 
WHAT  is  to  be  said,  HOW  it  is  to  be  said,  WHEN  it  is  to  be  said,  and 
WHO  is  to  say  it,  by  making  their  needs  publically  known.  (Kolter, 
1982)     Advertisers  base  their  advertising  strategies  upon  these 
critical  facts.     In  other  words,  once  the  target  group  and  their  needs 
are  identified,  the  advertiser  can  develop  the  message  so  their 
products  appear  to  meet  a  perceived  need  of  the  consumer.     The  extent 
to  which  a  company  can  present  itself  and  the  product,   (computers)  in 
relation  to  the  target  audience  needs,  advertising  can  be  successful. 

The  message  of  advertisements  is  designed  to  fulfill  a  need.  The 
message  content  is  also  designed  with  a  particular  appeal ,  theme,  idea 
or  unique  selling  proposition  often  linked  to  psychological 
considerations  of  the  target  group.     It  may  be  a  rational ,  emotional 
or  moral  appeal.     Rational  appeals  are  directed  to  the  rational 
self-interest  of  the  audience.     Emotional  appeals  stir  up  positive  or 
negative  emotion  that  will  motivate  product  interest  or  purchase. 
Moral  appeals  deal  with  the  issue  of  right  and  wrong. 

Advertising  may  also  be  looked  at  from  &  sociological  standpoint, 
as  pointed  out  by  Oof f man.     According  to  Bpf f man  in  the  book  @©Q£fir 
AdyerllafimfiQtg  "the  task  of  the  advertiser  is  to  favorably  dispose 
viewers  to  his  product,  his  means,  and  by  and  large,  to  show  a 
sparkling  version  of  that  product  in  the  content  of  gl amouous ' events. " 

One  can  interpret  thi*  statement  to  mean  that  the  job  of  the 

o 
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advertisers  is  two-fold.     First,  to  present  his  product  favorably  and 
sell  it,  ^nd  second,  to  communicate  to  the  viewer  social  implications 
of  buying  a  product  or  an  idea.       ftn  implication  of  thi  s_  is  that,,if 
yoy_buy_th Byproduct , ^y.{^_are_proba  j? ilY-rgpt^tff^buy  the  .other  ^i  deas „bei ng 
cemm^i^atel^  John  Berger  in  Wa*s_Si-§geAQfl 

m 

states  that,  "publicity  (advertising)  adds  up  to  a  kind  of 
philosophical  system.*     It  explains  everything  in  its  own  terms.  It 
interprets  the  world." 

Interestingly,  Bof f man  notes  that  the  advertiser  transforms 
"op ague  goings  on"  into  "readable  form"n     This  means  that  , 
advertisements  take  advantage  of  unclear,  unconcise  thoughts  and  ideas 
and  gives  them  structure  and  encoded  meaning,  thereby  increasing  the 
chances  that  the  viewer  will  purchase  their  product.     He  goes  on  to 
say  that,   "it  is  the  inclination  of  individuals  and  society  to  fall 
back  from  a  conscious  struggle  to  understand  ourselves  and  learn  about 

ourselves  at  a  remove,  and  to  accept  as  real  an  almost  wholly 

i 

unassumedi  self."    (Goffman  1976)  .  This  can  be  interpreted  as  meaning 

individuals  have  a  tendency  to  view  advertisements  and  accept  a 

I 

pictorial  staged  representation,  as  being  real  life,  thus  causing  them 


to  accept 


what  they  see  at  face  value  rather  than  view  the 


advertisements  with  a  critical  eye. 

Knowledge  of  what  microcomputers  can  and  cannot  do  is  needed  for 
rational  decisions  by  educational  leaders. (Judd  1984)     Therefore,  it 
is  logical | to  assume  teachers  will  seek  out  information  which  will 
enable  them  to  make  those  decisions*     This  coupled  with  the  fast  pace 

i   

i  « 

of  thits  technological  industry  encourages  teachers  to  look  to  ads  for 
educational  purposes.     Advertisers  also  realize  the  need  for  an 
educational!  approach  to  the  introduction  and  exhibition  of  their 
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product  to  suit  their  target  market.  "  Together  it  creates  a  marketing 
strategy  based  upon  an  educational  format. 

The  photographs  examined  in* this  paper  fit  the  criteria  for  being 
considered  educational  photdgraphs  as  discussed  in  the  previous 
parpagraph  —  that  they  seek  to  inform  the  educators  seeking 
information  about  the  product.     It  is  our  hypothesis  that 
advertisements  do  in  reality  teach,  and  teachers  who  view 
microcomputer  advertisements  learn  about  microcomputers. 

But  to  what  extent  do  teachers  also  learn  about  educational 
issues  surrounding  computers?    Are  social  messages  embedded  in  those 
advertisements? 

Judith  Williamson  notes  that  "Advertising  gives  goods  a  social 
meaning.     Material  things  we  need  are  made  to  represent  other 
non-material  things  we  need;  the  point  of  exchange  is  where  meaning  is 
created."     (Williamson  1978)     Boffman  <1976)  more  specifically  points 
out  the  nature  of  embedded  signals  when  pictures  are  arranged,  rigged, 

4 

or  set  up,  implying  that  scenes  real  enough  in  their  own  right  are 
brought  to  induce  radically  wrong  inferences.     Staging  the  scene 
results  in  pictures  of  covertly  contrived  displays;  the  picture 
appears  realistic,  but  is  not  reality.   It  follows "that  convert ly 
contrived  messages  could  influence  a  variety  of  decisions  made  by 
teachers  regarding  computers;  including  the  purchase  of  hardware, 
software,  integration  of  computers  into  the  curriculum,  the  role  of 
computers  in  education,  and  methods  of  assimilation  and  use  of  the 
computer  in  the  schools  and  individual  classrooms. 

It  is  because  of  these  "covert  messages"  embedded  in  advertising 
that  it's  necessary  to  scrutinize  advertisement's  with  a  critical  eye. 
One  must  understand  what  they  signify  and  the  potential  effect  on 

* 

322  319 


1 


teacher's  perceptions  of  computers.     It  is  like  the  "hidden 
curriculum"  of  advertising.    As  part  of  critical  evaluation  of 
advertising  one  must  consider:     what  is  the  message,  whose  message  it 
is,  and  what  is  the  message's  effect' on  the  viewer.    (Muffoletto,  1984) 
The  model  used  .in  examing  the  two  advertisements  chosen  for  this 

t 

paper  was  developed  by  Robert  Muffoletto  PhD.     In  his  model  he 
describes  three  elements  in  a  photograph  which  interact  with  the 

viewers  sum  total  experience  giving  the  viewer  meaning.     The  elements 

?■ 

discussed  are;  relationship,  prop  and  gesture.  * 

Relationship  as  concerned  with  the  spatial  positioning  of  objects 
in  the  picture.     The  relationships  may  be  thought  of  in  terms  of 
large/small,  inf ront/behind,  above/below,  apart/together  and  so  on. 
The  pictorial  representations  of  these  relationships  creates  a 
psychological  relationship.     For  example,  Sauf man  in  Bender 
Advertisements    points  out  * that  a  man  positioned  higher  then  a  woman 
in  a  photograph  symbolizes  the  man's  high  social  place  or  dominance. 

The  camera  angle  used  to  shoot  the  picture  will  also  affect  the 
relationship.     Monaco  (1981)  points  outs  "That  high-angle  shots, 
dimminish  the  importance  of  the  subject,  while  low-angle  shots 
emphasize  its  power.     For  example,  a  picture  shot  from  a  high  angle 
will  cause  the  viewer  to  feel  like  they're  looking  down  on  a  situation 
from  a  positon  of  power.    (Muffoletto,  1984) 

Props  are  objects  within  the  picture.     They  may  be  fully 
contained  in  a  frame  or  may  extend  beyond  a  frame*     Prdpe  themselves 
may  include  people f  clothing^  Ji  and  led  and  unhand led  objects.  These 
objects  constitute  the  content  of  the  picture.     The  interaction  of  th 
elements  in  the  frame  create  the  meaning-     For  instance,  similar  to 

the  use  of  "frame"  in  filmf  when  the  photographer  choses  to  depict/  '^J 

/  r*f- 

/ 
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action  which  extends  outside  the  con-finds  of  the  actual  picture  area, 
the  form  is  considered  to  be  "open".     In  an  open  form  the  viewer  is 
subliminally  aware  of  the  action  "which  extends  beyond  the  defined  area 
of  the  frame.     If  the  image  of  the  frame  is  to  be  considered 

«ee 

sel f -sufficient ,  then  the  form  is  considered  a  'closed  form ' . (Monaco, 
1981) 

Gesture  is  the  third  category  and  it  refers  to  the  action  of 
props  towards  other  props.     Typical  gestures. includes  reaching, 
touching,  looking,  pointing,  standing  and  walking.     Meaning  is  derived 
when  the  viewer  looks  at  the  props,  and  how  the  gestures  are 
directed. (Muff oletto, 1984) 

The  three  codes  of  relationship,  prop  and  gesture  interact 
together  to  form  the  image  to  be  decoded  by  the  reader.     It  is  in  the 
analysis  of  the  juxtaposition  of  these  three  codes  that  allows  the 
signification  of  the  image  to  be  deconstructed  and  them  reconstructed 
by  the  viewer  into  another  encoded  message  (Hall   1982).     It  is 
important  to  note  that  the  viewer  may  decode  a  message  which  differs 
from  the  intended  message.     The  message  decoded  depends  on  the 
individuals'  meaning  given  to  the  three  seperate  codes  in  the  picture. 

Two  ads  were  chosen  as  examples  of  how  the  model  would  be  used  to 
analyze  messages  encoded  in  ads.     Both  ads  appeared  in  the  magazine 
ClassrS9ffi-QS?afi«iii0a  . 

The  first  is  an  advertisement  for  an  APPLE  Computer  System, 
called  the  "School  Bus".    The  elements  the  picture  includes 
Proem 

-  a  woman  teacher 

-  three  male  students, 

-  three  female  students 

-  minorities  are  included  among  students 

-  seven  APPLE  computers,  and  monitors 

-  books  on  the  teachers'  and  students'  desks 
paper  and  pencils  on  desks 
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-  hair  brush  *  ' 
.-  two  tots  bags 

-  ons  WALKMAN  £g 
Key'Jtordjg     ~:*  ' 

-  efficient 

-  control 

-  communicate 
•-  teacher  effectiveness 

Re  1 at ion ships 

The  relationship  between  the  students  and  the  teacher  is  defined  by 
the  arrows  going  out  from  the  teacher's  desk  to  each  student,  and  back 
to  the  tsacher. 


gestucssi  •  .  ^ 

Students  and  the  teacher  are  all  reaching  out  toward  the  computer, 
touching  keyboards.'    Their  attention  is  directed  towards  the  monitors* 

■  ' 

*    The  messages  contained  in  this  ad  are  numerous.    The  obvious  ons  ^ 
is  to  buy  the  "school  bus"  system  to  manage  your  classroom.     The  other 
embedded  messages  could  be  interpreted  ass 

-  how  to  set  up  a  structured  computer  classroom  "* 

-  instruction  can  be  managed  eff iceintly  using  a  comprehensive 
system 

-  the  system  will  enhance  classroom  control 

-  the  system  will  increae  student  productivity 

-  the  system  will  fit  in  with  existing  curriculum 

-  computers  can  ba  easily  accessed  by  tooth  teachers  and  students 

-  instruction  can  be  individualized 

-  teachers  can  manage  instruction  saslly  via  computers 

-  all  students  can  learn  computing  / 

-  the  system  will  help  teachers  be  accountable  for  student  work 

-  students  can  learn  academic  basics  and  computing  at  the  _ 

•   same  time  '  ,--4 

-  communication  between  studsnts  and  teachers  can  increase 

-  communication  between  students  is  decreased 

-  both  students  and  teachers  "like"  working  with  computers  g 
The  second  advertisement  is  for  educational  materials  designed1  byl 

the  FISHEr  SCIENTIFIC  COMPANY.     The  ad  takes  a  futuristic  approach  in 


marketing  a  computer  called  the  "S+". 


-  one  teacher 

-  six  visible  students*  3  male,  3  female 

-  two  partially  visible  students;  x 
the  open  frame  indicating'  additional  students  in  the  room 

*-  eight  computer  terminals 

-  eight  different  pages  of  text  on  the  screens 

-  clean  desk  tops 

-  glimmering  lights 

-  unlock  imaginations  » 

-  awesome  responsibility 

-  tomorrow 

-  limitation-free 

The  relationship'  between  the  teacher  and  students  is  shown  by  the 
teacher  hovering  over  the  student  and  the  computer  monitor.     There  is 
no  relationship  indicated  between  the  students. 


Gestures 

The  teacher  is  gesturing  towards  the  student  and  computer  by  - 
leaning,  showing  acceptance  and  direction.     The  students  only  gestures 
are  towards  the  keyboard  and  monitor.     They  are  touching  the  keyboard 
and  looking  only  at  the  monitor. 


The  main  message  in  this  ad  is  to  purchase  a  computer  system  to 


manage  instruction.     The  other  covert  messages  may  he  interpreted  asi 

-  computer  education  is  the  "wave  of  the  future" 

-  students'  futures  will  be  enhanced  by  knowing  computer'' 
programming 

-  education  can  exist  independently  of  traditional  curriculum 
•  -  all  courses  can  be  taught  via  computer 

-  teachers  manage  instruction 

-  instruction  can  be  individualized 

-  students  will  stay  "on  task" 

-  behavior  management  will  be  simplified 

-  teachers  can  learn  programming 

-  students  can  and  should  learn  programming 

-  interactions  between  students  is  minimized  while  interaction 
between  teachers  and  students  is  maximized. 

The  two  advertisements  examined  support  the  notion  that  teachers 
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need  machines  to  make  the  learning  situation  better.     They  propose 
that  the  integati  on  of  computers  into  the  classroom  will  improve  the 
education  which  students  are  currently  receiving.     They  do  this  by 
stressing  pertinent  educational  issues  such  as  individualised 
instruction,  classroom  structure,  individually  paced  instruction, 
behavior  management  and  the  productive  use  of  classroom  time. 

In  conclusion 

Teachers  are  under  a  great  deal  of  pressure  to  integrate 
computers  into  the  curriculum.     Computer  companies  recognizing  this 
need,  target  this  audience  (teachers)  and  run  advertisements  which 
suggest  that  the  need  to  incorporate  computers  into  the  curriculum  is 
great.     The  advertisers  through  the  use  of  varied  appeals  indicate 
that  educational  needs  can  be  met  through  the  purchase  of  computers 
and  commercially  designed  software. 

However,  these  advertisements  have  psychological  as  well  as 
sociological  impact.     They  contain  educational  and  visual  messages 
which  cue  teachers  to  take  in  the  overt  and  covert  information 
contained  in  the  ads  and  decode  that  information.     Through  contrived 
use  of  the  three  codes,  relationship,  prop,  and  gesture,  an  image  is 
created  which  is  not  necessarily  a  representation  of  reality. 
Furthermore,  the  juxtaposition  of  the  elements  in  the  ad  may  lead  the 
viewer  to  decode  messages  other  than  the  "product  selling"  aspect  pf 
the  advertisement.     These  "embedded",  messages  tie-in  with  the  existing 
perceptions  regarding  the  use  of  computers  in  the  curriculum.  /In 
example  of  this  would  be  the  perceived  suggestion  that  incorporating 
computers  into  the  curriculum  will  improve  the  quality  of  education 
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and  offer  an  improved  alternative  over  what  already  exists.  Therefore 
the  "hidden  curriculum**  of  computer  advert! semente  has.  a  direct  effect  _J 
on  the  teacher's  perception  of  the  evolving  classroom  environment. 
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ABSTRACT 

j 

The  media  attribute  approach  of  this  study  hypothesized  that  compos i- 
tional  syntactic  placement  may  serve  to  bridge  the  processing  link  between 
the  learner's  cognitive  capacity  and  the  demands  of  a  simple  concept 

/ 

/  e 

attainment  task.    Specifically,  this  exploratory  experiment  was  questioning 
whether  a  particular  horizontal  frame  position  was  warranted  in  relation 
to  two  selected  cognitive abilities:   predictive  ability  and  field  articu- 
lation.   Compositional  syntactic  placement  was  manipulated  by  producing 

/' 

three  versions  of  sr-video taped  program  that  were  identical  in  every 
respect  with  the  exception  of  ten  visual  test  stimuli.    A  nonequivalent- 
control  group,  treatment -by-blocks  design  was  employed.    Analysis  of 
variance  and  multiple  comparison  techniques,  conducted  on  pretest -post test 
difference  scores  indicated  compositional  syntactic  placement  increased 
very  significantly  simple  concept  learning,  and, aptitude -treatment 
interactions  were  observed.    The  conclusion  of  the  r -udy  recommends 
further  experimental  research  be  conducted  on  the  media  attribute  theory 
with  an  aptitude  network  approach. 

\ 

\ 

\ 
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Compositional  Syntactic  Placement  and 
Simple  Concept  Learning  in  Female  Adults 

The  purpose  of  this  exploratory  inquiry  was  to  investigate  the 
media  attribute,  compositional  syntactic  placement,  for  potential  aptitude 
treatment  interactions.    Media  attributes  are  one  of  the  three  predominant 
theories  which  have  evolved  in  the  last  decade  (Torkelson,  1984).  Goodman 
(1968)  symbol  system  theory,  Olson's  (1976)  theory  of  instructional 
means,  and  Salomon's  (1979)  media  attribute  theory  have  been  succinctly 
summarized  and  analyzed  by  Snow  and  Salomon  (in  press)  for  the  Third 
Handbook  of  Research  on  Teaching.    All  three  theories  have  one  implicit 
tenet  in  common:    the  need  to  examine  the  effects  of  selected  media 
attributes  on  the  internal  cognitive  processes  of  the  learner. 

Many  symbol  systems  within  media  have  the  potential  to  facilitate 
or  debilitate  learning  by  calling  upon  different  processing  strategies 
(Bovy,  1981;  Gagne,  1980).    Some  coding  elements  can  save  mental  activity 
and  thus  ease  the  processing  burden  on  unskilled  learners;  however, 
skilled  learners,  on  the  other  hand,  may  show  a  decrement  in  cognitive 
processing  under  the  same  conditions  (Cronbach  &  Snow,  1977).  Those 
coding  elements  or  media  attributes  which  have  the  potential  to  affect 
cognitive  processing  may  be  identified  by  following  Goodman  (1968). 
Film  and  television  entail  a  number  of  levels  of  articulation — the  shot, 
the  sequence,  the  syntagm,  the  whole  program.    Each  of  these  requires 
its  own  rules  and  conventions  of  articulation  that  pertain  to  the  trans- 
formation and  composition  of  events,  objects,  and  relations  over  time 
and  space.    These  syntactic  modes  need  not  be  the  same,  for  all  levels  of 
articulation.    The  way  a  single  shot  is  composed  differs  from  the  way  a 
whole  sequence  of  shots  is   composed — e.g. ,  high  or  low  frame  placement 
to  indicate  importance;  left  or  right  frame  placement  to  indicate  pre- 
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dominance;  parallel  sequences  to  show  comparison  or  contrast;  parenthetical 
sequences  to  show  different  aspects  of  the  same  situation;  and  so  on 
^^(Kj^rup,  1977;  Mascelli,  1965;  Metz,  1974). 
Compositional  Syntactic  Placement 

Recognizing  that  there  are  numerous  media  attributes,  this  study 
focused  on  one  coding  system  element,  compositional  syntactic  placement. 
Compositional  syntactic  placement  may  be  conceptualized  as  the  relative 
horizontal  position  of  the  primary  symbol  or  abject  within  the  frame- 
left,  central,  or  right —  in  relation  to  other  secondary  elements  (Dondis, 
1973;  Zettl,  1973).    Art  historian  Hienrich  wolfflins  in  his  article 
"Uber  das  Rechts  und  Links  im  Blide"  in  1928  (cited  in  Arnheim,  1954) 
was  the  first  to  call  attention  to  the  fact  that  pictures  chenge  appearance 
and  lose  meaning  when  turned  into  their  mirror  images.    From  his  observa- 
tions, he  concluded  that  there  is  a  general  tendency  for  the  eye  to 
follow  a  path  which  begins  at  the  left  side  of  the  picture  and  ends  at 
the  right.    Wolfflins  was  able  to  describe  the  left -right  phenomenon, 
but  he  was  not  able  to  explain  it:    "Apparently  it  has  deep  roots,  roots 
that  reach  down  to  the  nethermost  foundations  of  our  sensuous  nature  (p. 
19)."    Except  for  a  few  experiments  with  inconclusive  results,  scientific 
study  regarding  left,  central,  or  right  placement  within  visual  media 
has  been  largely  ignored  (Metal linos,  1979). 

Nona  of  the  research  to  data  has  shown  any  cogently  significant 
difference  on  aesthetic  or  learning  variables  in  the  placement  of  elements 
within  the  frame  (e.g.,  Avery  &  Tiemens,  1975;  Fletcher,  1977,  1980; 
Herbener,  Van  Tuber gen  &  Whitlow,  1979).    One-study  by  Metal linos  (1980) 
reported  significant  differences  in  that  subjects  were  able - to  describe 
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the  shape  (p<01),  to  perceive  color  (p<.001>,  and.  to  recal^  (p<02) 
visual  stimuli  placed  on  the  left  side  of  the  screen  better  than  those 
placed  on  the  right.    Of  those  studies  reporting  trends,  Metal linos 
(1975)  and  Metal linos  and  Tiemens  (1977)  reported /that  retention  of 
visual  (but  not  verbal)  information  in  a  newscast  was  enhanced  by  place- 


ment on  the  left  side  of  the  screen,  while  ttiekastp  (1981)  reported  that 
mean  fixations  of  test  stimuli  measured  by  ocular  photography  favored 
the  right.    Hence,  limited  support  favored  the  left  orientation  in  dual 
comparisons  (left  vs.  right  placement), -but  a  more  accurate  method  of 
measurement  indicated  the  right  orientation.    With  the  exception  of  the 
Metal linos  and  Metal linos-Tiemene  studies,  none  of  the  experiments  attempt- 
ed to  evaluate  learning  effects,  and  these  researchers  reported  no 
significant  difference.    In  summarizing  the  currant  state  of  knowledge, 
Niekamp  (1981,  p.  147J  stated  that  the  data  "merely  reflect  the  conflicting 
views  and  uncertain  results  found  in  the  theoretical  research  literature 
.  .  .  [and]  .  .  •  that  these  [left -right]  differences  may  be  a  function 
of  and  are  affected  by  individual  human  differences." 
Cognitive  Abilities 

In  regard  to  the  cognitive  abilities  alluded  to  by  Niekamp  and 
Wolfflins,  Snow  and  Salomon  (1968)  as  well  as  others  (Clark,  1975  j  Levie 
&  Dickie,  1973;  Salomon  &  Clark,  1977;  Snow,  1970)  have  pointed  out  that 
individual  aptitudes  in  the  areas  of  intellectual  abilities,  cognitive 
styles  and  preferences,  learning  sets,  information  processing  and  coding 
strategies,  and  other  subtle  experimental  variables  are  likely  to  interact 
in  many  complex  ways  with  the  instructional  design  variables  of  visual 

stimuli/   Some  evidence  exists  that  two  variables  may  have  the  potential 

■  * 
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to  affect  simple  concept  learning  from  a  media  attribute:  field  articu-' 
1 at ion  and  predictive  ability. 

Field  Articulation.    Gagne* (1977)  has  specified  that  discrimination 
and  generalization  skills  are  basic  to  all  concept  learning.    He  noted 
that  the  learner  must  first  distinguish  relevant  details  (discriminate), 


then  further  organize  this  information  as  a  basis  for  classifying  new 
items  as  examples  or- nonexamples  of  a  concept  class  (generalize). 
Learners  appear  to  differ  in  their  ability  to  discriminate  and  generalize, 
and  the  cognitive  style  construct,  field  articulation  (field  independence 
vs.  field  dependence),  has  been  related  empirically  to  these  differences 
(Wit kin,  01 1 man,  Raskin  &  Karp,  1971).    Previous  research  indicates  that 
concept  attainment  tasks  are  often  more  demanding  for  field-dependent 
individuals  ( Dicks tein,  1968;  Kirschenbaum,  1969;  Wit kin,  Moore,  Goodenough 


4  Xdx,  1977).    Individuals  Mho  are  perceptually  field-dependent  have 
been  found  to  experience  their  world  in  a  less  differentiated  fashion 
when  dealing  with  perceptual  cognitive  tasks  (Witkin  &  Goodenough,  1976; 
Witkin,  Goodenough  &  01 t man,  1977);  that  is,  field-dependent  persons 
tend  to  accept  the  visual  field  passively  as  presented  and  ignore  impor- 
tant details  which  presumably  are  not  salient  to  them.  Furthermore, 
they  appear  to  be  dominated  by  the  most  salient  or  noticeable  parts  of  a 
visual  (Dickstein,  1968  p Kirschenbaum,  1968).    Their  tendency  to  display 
less  differentiated  functioning  is  evident  also  in  the  processing  strategies 
they  use  when  directed  to  form  a  concept  hypothesis.    Their  hypothesis- 
testing  strategy  has  been  associated  with  a  partist  approach  which  lacks 
organization  (Goodenough,  1976;  Kirschenbaum,  1968).  field-dependent 
learners  may  be  handicapped  by  unstructured  materials  and  a  lack  of 
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salient  details  upon  which  to  base  their  hypothesis.    The  difficulty  of 
field-dependent  learners  may  be  particularly  apparent  when  instructional 
time  is  United  by  a  fixed -paced  presentation.    Pishkin  (1965)  has 
suggested  that  specification  of  concept  attributes,  in  some  manner,  may 
 reduce  learning  difficulty  for  field-dependent  individuals  by  reducing  

— 

the  number  of  hypotheses  to  be  considered. 

The  field-dependent  strategy  may  be  contrasted  with  that  of  the 
field -dependent  learners.    These  learners  are  capable  of  more  differen- 
tiated functioning;  that  is,  they  are  capable  of  using  their  restructuring 
skills  as  internal  mediational  processes  (Wit kin,  Moore,  Goodenough  & 
Cox,  1977).    Their  hypothesis-testing  strategies  have  been  associated 
with  a  wholist  approach  which  imposes  organization  (Goodenough,  1976; 
Kirschenbaum,  1968).    Frederick  (1968)  has  noted  that  only  the  more 
analytic  learners  are  sensitive  to  amounts  of  relevant  information.  The 

*  • 

field-independent  learner  tends  to  scan  the  first  positive  concept  example 
and  to  retain  all  its  attributes  for  later  comparison  with  those  in 
subsequent  examples.    If  a  hypothesis  is  proven  to  be  inappropriate, 
then  a  revised  hypothesis  is  formed.    The  wholist  strategy  of  hypothsis 
testing  is  more  active  than  the  partist  approach  and  has  resulted  in 
better  learning  performance  particularly  when  subjects  were  under  time 
pressure  (Bruner,  Goodnow  &  Austin,  1956;  Bourne,  1?66).    In  his  discus- 
sion  of  hypothesis-testing  strategies,  Mayer  (1977)  pointed  out  that  the 
superiority  df  the  wholist  strategy  could  be  due  to  its  reduced  demand 
on  memory,  because  the  wholist  is  able  to  eliminate  those  attributes 
which  fail  to  reappear. 
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Predictive  Ability.    The  Predictive  Ability  Test  was  developed  in 
the  context  of  a  theory  of  behavior  which  proposes  that  general  ability 
can  be  estimated  by  the  measurement  of  predictive  ability  (Friedman, 
1974,  1975;  Friedman  &  Willis,  1981).    General  ability  (G)  is  a  complex 
measure.    The  hierarchical  model  of  ability  organization,  as  interpreted 
by  Cat tell  (1971),  has  at  its  highest  level  a  distinction  between  fluid- 
analytic  intelligence  (Gf)  and  crystallized -verbal  intelligence  (Qc). 
After  decades  of  factor  analytic  debate,  this  or  related  hierarchical 
views  have  finally  become  popular  because  they  fit  existing  data  rather 
well  while  offering  some  hope  of  parsimony  (Snow,  1977,  1980).  Horn 
(1976)  summarized  much  recent  correlational  research  under  these  rubrics, 
adding  spatial  visualization  ability  (Gy)  to  the  general  level.  Cronbach 
and  Snow  \1977)  adopted  such  a  hierarchical  view  in  attempting  to  make 
sense  of  a  large  number  of  studies  which  were  designed  to  take  into 
account  learner  aptitudes  that  might  interact  with  media  and  task 
characteristics. 

The  Cronbach -Snow  review  noted  that  G  has  been  the  most  widely 
studied  aptitude  construct  in  instructional  media  research  and  has 
produced  the  most  aptitude-treatment  interaction.    The  general 
hypothesis  from  the  review  is  that  as  learners  are  required  to  organize 
their  own  study  and  build  their  own  comprehension,  the  more  able  learners 
are  capable  of  capitalizing  on  their  strengths  profitably.    As  instruc- 
tional treatments  were  arranged  to  relieve  learners  from  difficult  read- 
ing /analyzing  complex  concepts  and  building  their  own  cognitive  structures, 
such  treatments  seemed  to  compensate  for,  or  circumvent,  less  able  learners' 
weaknesses  end  to  reduce  the  regression  slope  of  G.    Some  kinds  of  treatment 
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supplied  cognitive  models  have  actually  interferred  with  the  performance 
of  high~G  students  in  instructional  media  research  (e.g.,  Salomon,  1968, 
1979).    A  "Zoom  Film"  reported  by  Salomon  (1974)  overtly  supplanted  the 
process  of  relating  parts  to  wholes  and  thus  facilitated  learning  for 
those  subjects  who  could  not  easily  execute  that  process  on  their  own. 
However,  the  same  supplanting  element  debilitated  learning  of  better- 
skilled  subje-ts  apparently  by  interferring  with  their  depth  of  processing. 
Also  included  in  a  second  experiment  of  the  study  was  an  evaluation  of 
field  articulation  (a  measure  of  the  fluid  analytic  (Gf )  and  Spatial 
visualization  (Gv)  cluster  of  abilities  according  to  Snow,  1977,  1980), 
resulting  in  the  same  aptitude-treatment  interaction. 

Considering  the  above  selected  cognitive  abilities,  the  query  of 
this  research  was  to  determine  whether  compositional  syntactic  placement 
was  effective  in  improving  simple  concept  learning  from  audiovisual  ^ 
media*    This  researcher  was  asking  whether,  under  the  impact  of  differ- 
ent learner  attributes,  a  particular  frame  position  was  warranted. 
Performance  by  female  subjects  st  different  levels  of  these  cognitive 
abilities  was  investigated  with  an  instrument  which  sought  to  isolate 
simple  concept  learning  derived  from  an  instructional  television  program 

* 

on  women* s  sex  roles  produced  in  three  compositional  styles  specifically 
for  this  study. 

METHOD 

Subjects 

Female  adults  were  chosen  as  the  subjects,  since  women  account  for 
upwards  to  75  percent  of  the  participants  in  telecourse -centered  and 
distance  learning  programs  (Bryan  h  Formanf  1977;  Zigerail,  1976). 
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Attendees  to  a  non Formal  workshop,  "Sex  Roles  and  How  to  Get  Out  of 
Them,'*  conducted  in  the  central  Georgia  area  served  as  voluntary  subjects. 
A.  total  of  152  women  completed  all  portions  of  the  experiment.  Age 
ranged  from  19  to  72  years  (M  =  38.96,  SO  =  10.34),  and  the  educational 
level  attained  ranged  from  10  to  19  years  (M  =  14.. 04,  SO  =  2.05).  None 
of  the  subjects  were  full-time  students. 
Materials 

Stimuli.    A  nine-minute  videotaped  program  entitled,  "Obstacles  to 
Career  Growth—Sex  Roles,"  was  designed  specifically  for  this  experiment. 

program  contained  ten  simple  concepts  on  sex  role  indicators  which 
forced  the  basis  for  a  stimuli  set  and  for  test  questions.    Each  stimulus 

was  constructed  in  three  versions  for  left,  right,  and  central  syntactic 

V 

placement  by  a  graphic  artist  who  controlled  symbol  size,  color,  and 

background.  Three  experimental  tapes  were  carefully  constructed  with  an 

electronic  editor  to  ensure  that  each  test  stimulus  was  exactly  the  same 

length  in  all  versions.    The  ten  test  stimuli  embedded  within  the  program 

were  exposed  on  the  screen  from  7.66  to  13.60  seconds  (M  =  10.72).  Thus, 

the  only  difference  between  the  left,  right,  and  central  versions  of  the 

experimental  videotape  was  the  composition  of  the  test  stimuli  set. 

The  Criterion  Tests.    Two  multiple-choice  questions  with  five  options 

were  constructed  for  each  of  the  ten  sex  role  indicator  concepts  within 

the  videotaped  program.    Two  additional  questions  were  added  to  insure 

comprehension  of  concepts  that  may  have  been  confused  with  definitions 

derived  from  common  usage.    To  determine  if  any  life -history  events 

might  have  altered  significantly  the  characteristics  of  the  groups, f 

\  .  •  i 

true-false  questions  on  reading  sex  role,  material  and  on  a  personal 
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encounter  with  a  sex  typing  situation  were  included  on  the  pretest .  In 
otder  to  reduce  the  length  of  the  22 -item  questionnaire  to  four  pages,  a 
modified  matching  format  was  utilized  for  the  first  twelve  questions, 
since  they  involved  definitions  of  concepts  and  attributes!    The  final 
reliability  of  the  pretest -post test  criterion  instruments  determined 
during  a  pilot  study  was  .76  as  measured  with  the  Kuder-RichardsorT 
Formula  20. 

Predictive  Ability  Test  (PAT).    The  PAT  was  developed  in  response 

to  mounting  criticism  of  intelligence  tests  in  the  early  1970*s  resulting 

from,  (a)  the  lack  of  a  definition  and  theory  of  intelligence,  (b)  cultural 

bias,  (c)  the  similarity  of  intelligence  test  to  achievement  tests,  and 

(d)  the  reliance  of  intelligence  tests  on  verbal  ability  (Friedman, 

m 

1974).  Predictive  ability  is  a  measure  of  general  intelligence  ability 
based  upon  the  individual's  aptitude  to  make  prediction  about  events 
(Friedman,  1975;  Friedman  &  Willis,  1981).  This  definition  is  based 
upon  expectancy  learning  theory  which  defines  learning  in  terms  of  the 
organism's  ability  to  interact  with  the  environment.  While  there  is 
relatively  little  agreement  on  a  definition,  it  should  be  remembered 
that  some  verj  old  definitions  of  intelligence*  from  Binet  on,  include 

e 

such  phrases  as  "adaption  to  a  goal , "  "capacity  to  reorganize  behavior 
patterns  for  effective  action,"  "maintenance  of  definite  direction  and  » 
concentration,"  "autocriticsm,"  and  in  sum,  "ability  to  learn"  tSnow, 
1978). 

The  30 -item  picture  instrument  requires  the  respondent  to  make 
predictions  about  events  that  are  common  to  one's  everyday  experience, 
rather  than  about  events  which  are  generally  learned  in  school.  Sawyer 
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(1975)  reported  the  test  items  have  an  average  factor  loading  on  the 
First  principle  axis  (the  predictive  ability  factor)  of  .49  with  a  range 
from  .29  to  .71.    The  proportion  of  common  variance  accounted  for  by  the 
major  factor  in  the  unrotated 'solution  (vsrimax  rotation)  was  .47  with 
none  of  the  other  factors  accounting  for  more  than  .09  of  the  variance.  , 
The  PAT  has  a  reliability  of  .90  as  measured  with  the  Koder -Richardson 
20  formula.    The  average  difficulty  index  is  .60  with  a  discrimination 
index  of  .53.    During  its  standardization  and  initial  study,  the  instru- 
ment correlated  highly  with  different  indexes  of  successful  living- 
social  adjustment,  success  in  education,  and  job  status.    For  the  purpose 

« 

of  this  exploratory  study,  the  observed  mean  score  on  the  PAT  (19)  was 
used  to  separate  the  subjects  into  two  relative  block  groups:  high  or 
low  ability. 

Field  Articulation.    Field  articulation  is  a  cognitive  style  con- 
struct that  io  associated  with  competence  at  disembedding  in  perceptual 
and  nonperceptual  problem  solving  tasks  (Messick,  1976).    An  individual 
who  has  difficulty  disembedding  simple  figures  from  complex  designs  in 
the  18 -item  Group  Embedded  Figures  Test  (GEFT)  is  Vie  Independent .  A 
field  dependent  tends  to  be  hindered  in  solving  problems  which  require 
isolating  an  essential  element  from  the  context  in  which  it  is  presented 
and  using  it  io  a  different  context.    Individuals  who  do  well  on  the 
GEFT  are  field  independent  and  have  the  ability  to  delineate  and  struc-  * 
ture  perceptual  and  symbolic  material  (Witkin,  Oltman,  Raskin  &  Karp, 
1971).    Several  studies  have  indicated  that,  although  field-independent 
and  field-dependent  persons  are  not  appreciably  different  in  learning 
-ability  or  memory,  field-dependent  persons  tend  to  be  better  at  learning 

s 
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and  remembering  social  material.    Field-dependent  individuals  also'  are 
more  likely  to  require  externally  defined  goals  and  reinforcements  than 
field-dependent  individuals  Mho  tend  to  have  seW -de fined  goals  and 
reinforcements  (Goldstein  &  Blackmen,  1978;  Wit  kin,  Moore,.  Goodenough  & 
Cox,  1977).    Furthermore,  field-independent  people  are  less  inclined  to. 

\ 

\ 

be  influenced  by  the  environment  and  perform  well  in  circumstances. .where  

critical  elements  of  a  problem  have  to  be  taken  out  of  context  and  restruc- 
tured in  a  different  way,  such  as  mathematical  reasoning,  verbal  fluency, 
and  spatial  abilities  (Wit kin,  Moore,  Oltman,  Goodenough,  Fri  »dman,  Owen 

&  Raskin,  1977).    For  the  purpose  of  this  exploratory  study,  the  observed 

/ 

mean  score  on  the  GEFT  (8)  was  used  to  separate  the  subjects  into  two 
relative  block  groups:    field-dependent  and  field-independent. 

j  '•  * 

Apparatus 

At  the  front  of  each  classroom  where  the  workshops, were  held,  two 
Sony  KV-1515  Trinitron  color  receivers  with  a  32  centimeter  horizontal 
x screen  width  were  placed  for  optimal  subject  viewing."  The  teat  stimuli 

f 

videotapes  were  played  bactf  on  Sony  VP -2000  U-matic  videocassette  players. 
Utilizing  an  internal  radio  frequency  generator,  the  signal  from  the 
videocassette  was  delivered  to  each  monitor  by  cable  through  an  Archer 
two-way  splitter  and^directional  coupler  (Catalog  No.  15-1141B).  Color 
bars,  audio  tone  and  a  cross  hatch  pattern  recorded  from  a  Lenco  PFM-300 
signal  generator  on  the  beginning  of  each  stimulus  tape  were  utilized  to 
ensure  that  every  monitor  reproduced  the  audio  and  video  signals  accurately. 
Horizontal  end  vertical  picture  deflections  were  adjusted  by  *  television 
engineer  prior  to  the  experiment  so  there  was  less  than  five  millimeters 
deviation  for  all  monitors  in  the  classrooms. " 

*  .  »  » 
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Procedure 


-ERIC 


.  the  nonequi valent -control-c-group  design  was  utilized  (Campbell  & 
Stanley,  1963).    A  total  of  six  workshop  Session's  were  conducted,  and 
randomization  of  the  treatment  videotapes  was  employed ,    A  double  blind 
technique  was  applied  to  help  reduce  the  effect  of  reactive  arrangements. 
Subjects  were  unaware  they  were  participating  in  an  experiment  until  the  • 
conclusion  of  the  workshop',  and  the  workshop  leaders  as  well  as  test 
administrators  were  unaware  of  which  treatment  was  being  administered. 
All  workshop  leaders  had  advanced  degrees  in  counseling  and  guidance  or 
clinical  psychology,  and  all  test  administrators  had  formal  instruction 
if i  testing  and  measurement.    Three  training  sessions  totaling  over  four 
haurs  were  conducted  for  these  six  individuals  prior  to  the  workshop 
sessions.  • 

Every  workshop  followed  the  same  format.    Participants  were  encour- 
aged to  seat  themselves  at  the  front  of  the  classroom  in  order  that  (a) 
no  one  be  farther  away  than  12  times  the  horizontal  width  of  the  television 
receiver  screen,  and  (b)  a  line  of  vision  of  not  more  than  45  degrees 
from  the  \center  line  axis  perpendicular  to  the  picture  tube  be  maintained 
as  a  maximum  viewing  angle  (Chapman,  1960).    After  an  initial  overview 
of  the  session  by  the  trained  female  workshop  leader,  the  pretest  was 
administered  and  followed  immediately  by  the  syndetic  visual  treatment 
and  then  the  post test.    This  eliminated  any  incidental  learning  which, 
might  have  been  contributed  by  the  discussion  period  which  ensued. 
Subsequent  -to  the  discjgsion  period  and  a  short  break,  the  PAT  and  GEFT 
were  completed  by  the  participants  under  the  supervision  of  the  trained 
female  test  administrator.    In  the  final  segment  of  the  workshop,  attendees 

•  / 
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were  informed  that  grouped  scores  would  be  used  by  the  Center  for  Continu- 
ing Education  of  Women  at  Mercer  university  in  developing  future  workshops 
and  in  a  study  on  developing  videotaped  materials. 

RESULTS 

Group  Equivalence 

Since  the  experiment  utilized  six  intact  groups,  two  for  each  of 
the  three  treatments,  equivalence  of  the  three  combined  groups  (njeft=50, 
Hcenter=-^*  Dxigbt2^)  was  an  important  question  to  investigate  prior  to 
testing  for  the  experimental  hypothesis.    A  three  level,  one-way  analysis 
of  variance  was  used  in  analyzing  the  data  between  the  groups  for  each 
subject  background  and  aptitude  variable:    age,  F  (2,149)  =  .03,  M  = 
38.96;  educational  level,  F  (2,149)  =  1.30,  M  =  14.03;  predictive  ability, 

F  (2,149)  =  1.72,  M  =  18.49;  field  articulation,  F  (2,149)  =  .19,  M  = 

L 

8.47;  pretest  score,  F  (2,149)  =  1.16,  M  =  9.99.    The  results  showed  no 
significant  differences  between  the  groups  on  any  of  the  variables  at 
the  .05  level  of  ^significance. 

To  determine  if  the  subjects  had  dissimilar  life-history  experiences 
which  might  hsve  nltered  the  equivalence  of  the  groups,  the  two  true- 
false  questions  on  \tie  pretest  were  analyzed  using  the  independent  samples 
Chi -Square  Test.    No  significant  differences  were  noted  between  the 
groups  at  the  .05  lev^sl  for  subjects  having  read  within  the  last  month 
Bex  role  materials,  *£*(2,Nsl52)  =  .19,  or  having  had  a  recent  encounter 

I  A 

with  a  sex  typing  situation,  #?(2>Nzl52)  =  .53.    Most  subjects  responded 

in  the  negative  to  these  two  questions  with  57. 9&  and  59.955,  respectively, 
circling  false. 
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Analysis  of  Variance 

A  3  X  2  k  2  unweighted  means  analysis  of  variance  was  conducted  to 
test  the  major  hypothesis  of  the  study.    The  three  independent  variables 
were  compositional  syntactic  placement,  predictive  ability,  and  field 
articulation.    The  dependent  measure  was  pretest -post test  difference 
scores.    Table  1  presents  a  summary  of  the  analysis. 


Insert  Table  1  about  here. 


The  analysis  of  variance  resulted  in  a  highly  significant  main 
effect  for  compositional  syntactic  placement,  F  (2,140)  =  19.92,  p<. 0001. 
A  significant  main  effect  was  also  achieved  for  field  articulation,  F 
(1,140)  =  6.23,  JK.Q5,  with  field-independent  subjects  achieving  higher 
mean  difference  scores  (M  =  5.31)  than  field -dependent  subjects  (M  = 
3.64).    Two  significant  first -order  interactions  were  observed  as  well, 
requiring  caution  in  the  interpretation. of  the  main  effects:  placement 
by  field  articulation,  F  (2,140)  =  3.56,  p_<.05,  anb\  ability  by  field 
articulation,  F  (1,140)  =  9.76,  p<.01.    While  not  significant,  the  second- 
order  interaction,  placement  by  ability  by  field  arti  cu^aUon,  was  at 
the  CC  =  .10  level,  £  (2,140)  =  2.32.  X 

Scheffe's  (1953)  S  method  was  used  to  assess  Significant  contrasts 
for  the  compositional  syntactic  placement  main  effect.    Subjects  who  x 
received  the  right  syntactic  treatment  achieved  a  significantly  greater 
mean  difference  score  (M  =  6.66)  than  either  the  left  (M  =  4.32,  £<.01) 
or  the  central  (M  =  2.60,  £<D01)  placement  groups.    Subjects  who 
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received  the  left  syntactic  treatment  also  scored  significantly  higher 
than  the  central  placement  group  (p_<.05). 

With  two  significant  first-order  interactions  and  a  second-order 
interaction  approaching  significance,  test  of  simple  main  effects  were 
applied  at  all  levels  of  one  factor  at  each  separate  level  of  t%  other 
factor  (Kirk,  1968)  for  interactions  involving  compositional  syntactic 
placement,  field  articulation,  and  ability  (See  Table  2). 


Insert  Table  2  about  here. 


The  test  of  simple  main  effects  revealed  a  significant  interaction  at 
less  than  .01  level  for  placement  at  field  independence,  F  (2,140)  = 
16.92,  and  placement  at  field  dependence  F  (2,140)  =  8.11.    field  articu- 
lation  at  right  sny tactic  placement  was  also  significant  at  less  than 
the  .01  level,  F  (1,140)  =  13.09  (See  Figure  1). 


Insert  Figure  1  about  here. 


Sche  ffe'  3  S  btm t hod  applied  to  compositional  syntactic  placement  at 
field  independence  (See  Table  3)  and  compositional  syntactic  placement 
at  field  dependence  (See  Table  4)  provided  further  information  to  aid  in 
the  understanding  of  the  interaction* 


Insert  Table  3  and  Table  4  about  here* 
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Subjects  in  the  field-independent,  right  stimulus  group  had  a  sig- 
nificantly higher  mean  difference  score  (M  =  8.46)  than  those  in  the 
field-independent,  central  group  (M  =  3.26,  pl.OOl)  or  those  in  the 
field-independent,  left  group  (M  =  4.05,  £<.QQ1).    Similarly,  subjects 
in  the  field-dependent  right  group  had  a  significantly  higher  mean 
difference  score  (M  =  5.00)  than  those  in  the  field-dependent,  central 
group  (M  =  1.88,  £^.01);  however,  the  mean  difference  score  for  the 
field-dependent,  left  group  (M  =  4.54)  only  approached  significance  from 
the  fie Id -dependent ,  central  group.    Thus,  a  disordinal  interaction 
occurred  for  the  left  stimulus  group.    Field-dependent  subjects  had 
higher  mean  pretest -post test  difference  scores  than  field-independent 

subjects  in  the  left  stimulus  group,  contrary  to  the  other  two  groups 

■ 

where  field-independent  subjects  scored  higher. 

The  difference  in  gain  scores  was  significant  for  high  and  low 
ability  subjects  when  considering  their  field  articulation.    The  test  of 
simple  main  effects  revealed  a  significant  interaction  at  less  than  tr«* 
.05  level  for  ability  at  field  independence,  f_  (1,140)  =  6.62,  and  a 
significant  interaction  at  less  than  the  .01  level  for  field  articu- 
lation at  low  ability,  F  (1,140)  =  16.01  (See  Figure  2).    Low  ability, 
field  independent  subjects  had  a  significantly  higher  mean  difference 


Insert  Figure  2  about  here. 


score  (M  =  6.18)  than  either  their  low  ability,  field-dependent  counter- 
parts (M  s  3.06)  or  high  ability,  field-independent  subjects  (M  =  4.40), 
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but  they  did  not  differ  significantly  from  high  ability,  fie Id -dependent 
subjects  (M  =  4.75). 

Though  not  significant  (p_  =.10),  a  graph  of  the  placement  by  ability 
by  field  articulation  interaction  will  ameliorate  our  understanding  of 
the  experimental  variables  effect  (See  Figure  3).    for  the  low  ability 

Insert  Figure  3  about  here. 


field-independent  subject,  these  data  showed  that  right  syntactic 
placement  was  superior  to  the  otter  two  orientations*    High  ability, 
field-independent  and  high  ability,  field-dependent  subjects  also  per- 
formed superiorly  in  the  right  syntactic  placement  group.    The  performance 
of  the  low  ability,  field-dependent  subject  was  Vi  entirely  different 
matter.    These  subjects  performed  tetter  in  the  left  syntactic  placement 
group.    Notice  that  the  graph  represented  in  figure  3  for  the  central 
and  right  syntactic  groups  mirrored  the  ability  by  field  articulation 
interaction  presented  in  Figure  2  (though  at  a  wider  angle),  whereas  the 
graph  for  the  left  syntactic  placement  group  was  exactly  the  180  degree 
inverse  of  Figure  1.    unfortunately,  this  second  order  interaction  only 
had  limited  support. 

DISCUSSION 

The  syntactic  placement  of  visual  symbols  within  a  videotaped 
presentation  was  shown  to  increase  concept  learning  for  female  adults, 
regardless  of  whether  the  symbol  was  in  the  left  or  right  orientation; 
however,  the  rigt»t  syntactic  placement  was  predominantly  superior,  fhis 
effect  for  placement  was  not  to  be  expected  based  on  previous  research, 
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since  six  of  the  jeven  aesthetic  studies  reviewed  dealing  with  syntactic 
placement  found  no  significant  difference,    the  one  study  (Metal linos, 
1980)  that  resorted  significant  differences  found  only  that  subjects 
were  able  to  describe  the  shape  and  to  recall  the  stimuli  placed  on  the 
left  side  of  the  screen  better  than  those  placed  on c the  right.  While 
not  significant,  Niekamp  (1981)  had  reported  mean  fixations  of  test 
stimuli  measured  by  ocular  photography  favored  the  right.    The  disrepancy 
between  these  results  and  the  previous  studies  may  be  attributed  to  the 
less  distinctive  visuals  utilized  in  the  experiments,  such  as  the  generic 
visuals  of  a  newscast  (e.g.,  them is  for  law  stories,  the  caducous  for 
medical  stories)  or  the  more  universal  visuals  of  exploratory  aesthetic 
research  (e.g.,  circles,  pastoral  scenery).    Metal linos  (1975)  and 
Metal linos  and  Tiemens  (1977)  noted  this  possibility  as  well. 

Results  from  the  pretest -post test  difference  scores,  confirmed  that 
learners  with  field-dependent  aptitudes  have  difficulty  with  externally- 
paced  concept  attainment  tasks  which  require  the  ability  to  discriminate 
essential  information  (Dickstein,  1968;  Kirschenbaum,  1968;  Witkin, 
Moore,  Goodenough  &  Cox,  1977).    Field-dependent  subjects'  performances 
were  influenced  by  visual  orientation  but  not  to  the  same  level  of  perfor- 
mance as  their  counterparts.    Field-independent  subjects'  performances 
on  mean  gain  scores  were  facilitated  highly  through  the  use  of  right 
syntactic  placement  as  opposed  to  central  or  left  syntactic  placement. 
This  finding  was  in  agreement  with  that  of  Frederick  (1968)  who  found 
that  only  more  analytic  learners  were  sensitive  to  amounts  of  relevant 
information  and  with  that  of  Salomon  (1974,  1979)  who  observed  that 
modeling  cue  attendance  favored  only  the  highly  field-independent  learners. 
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It  appears  possible  that  right  compositional  syntactic  placement  decreased 
abstraction  tins  and  processing  effort  which  permitted  more  efficient 
and  effective  processing  by  both  field-independent  and  field -dependent 
subjects,  though  field-dependent  individuals  may  still  have  had  greater 
difficulty  in  isolating  relevant  information.    Perhaps  other  combined 
functional  attributes  were  needed  to  provide  a  more  powerful  cue- 
summation  effect  for  field-dependent  learners  to  supplant  their 
processing  weaknesses. 

In  light  of  an  aptitude  interconnection  or  aptitude  complexes  explana- 
tion the  findings  from  the  two-way  interaction  of  predictive  ability  and 
field  articulation  warrant  consideration.    While  predictive  ability  did 
not  interact  with  compositional  syntactic  placement  as  visual  modeling 
of  a  mental  skill  (cue  attendance)  interacted  with  general  ability  in 
Salomon's  (1968,  1974,  1979)  studies,  the  resulting  two-way  trait  inter- 
action suggested  that  certain  combinations  of  ability  and  field  articualtion 
may  have  differentially  affected  learner  outcomes.    Although  the  right 
compositional  syntactic  placement  facilitated  simple  concept  learning  . 
for  all  field-articulate  learners,  the  two-way  interaction  of  variables 
implied  that  a  specific  placement  condition  may  provide  effective 
compensatory  supplantation  for  high  ability,  field^de pendent  learners. 

Furthermore,  a  different  placement  condition  may  also  function  to  maximize 

\ 

the  appropriate  processing  modes  of  the  low  ability,  field-independent 
learners. 

Limited  support  for  this  interpretation  is  provided  further  by  the 
three-way  interaction  of  field  articulation,  predictive  ability,  and  \ 
compositional  syntactic  placement  (£  =  .10).    The  utilization  of  syntactic 
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placement  appeared  to  reduce  processing  and  time  demands  which  functioned  , 
to  isolate,  emphasize,  and. organize  relevant  information  for  the  high 
ability,  field-dependent  learner.    In  fact,  this  orientation  provided 
superior  cue -summation  for  all  but  the  low  ability,  field -dependent 
learner.    Apparently,  the  right  orientation  added  slightly  to  the  processing 
demands  of  the  low  ability,  field-dependent  learner,  whereas  the  left 
orientation  aided  this  learner  by  isolating  and  directing  attention  to 
the  relevant  concept  details.    The  left  treatment  condition  was  the  only 
one  in  which  the  low  ability,  field-dependent  subjects  outperformed 
their  high  ability,  field-dependent  counterparts.. 

The  general  superiority  for  compositional  syntactic  placement  may 
be  taken  as  tentative  support  for  Saloman's  (1979)  media  attribute  theory, 
where  the  choice  of  specific  coding  elements  within  a  symbol  system  may 
effect  the  ease  with  which  information  is  processed  by  a  learner.  These 
external  stimulus  cue  summations  may  have  increased  both  learning  efficiency 
and  effectiveness  by  reducing  the  number  of  possible  hypotheses  (Pishkiri, 
1965),  which  may  have  been  helpful  in  reducing  the  memory  demands  associated 
with  field-dependent  hypothesis-testing  strategies  (Mayer,  1977).  By 
providing  ready-made  transformations,  the  instructional  materials  may 
have  compensated  for  the  learner's  deficiency  by  providing  a' mode  of 
presentation  that  the  learner  could  not  provide  (Snow,  1970).    In  other 
words,  the  compensatory  treatments  achieved  for  the  learners  what  they 
could  not  do  for  themselves  because  of  a  particular  aptitude  weakness  in 
discriminating  relevant  cues  (Salomon,  1974). 

This  research  has  opened  the  door  to  the  study  of  media  attributes  • 
or  coding  systems  and  their  relation  to  learner  attributes.  Cronbach 
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and  Snow  (1977)  have  suggested  that  the  design  of  instruction  should  be 
selective  according  to  aptitude.    Their  emphasis  is  directed  towards  the 
choice  of  appropriate  instructional  techniques ,  rather  than  the  selection 
of  a  ffiedi'  /t  as  an  invariant  entity.    This  view  is  particularly  appropriate 
-  when  considering  the  implications  for  instructional  practice  suggested 
by  this  study.    First,  the  results  suggest  practical  recommendations  in 
terms  of  the  specific  processes  reflected  by  field-dependent  and  field- 
independent  female  learners  when  dealing  with  compositional  syntactic 
placement  in  kinetic  media.    Second,  the  findings  support  the  view  that 
the  design  of  instruction  should  be  selective  according  to  aptitude 
because  of  cognitive  style  differences  in  processing  information  on  a 
simple  concept  attainment  task.    Although  the  same  compositional  syntactic 
treatments  often  facilitated  both  field-dependent  and  field-independent 
performance,  one  important  implication  should  not  be  overlooked.  While 
the  effective  treatments  permitted  field-independent  individuals  to 
perform  more  successfully,  these  same  treatments  may  have  been  imperative 
for  acceptable  performance  by  field-dependent  learners  who  may  have 
needed  specific  supplantation  in  order  to-  meet  a  basic  performance  criterion. 

While  not  a  rigid  test  of  the  general  hypotheses  due  to  the  specific 
content  and  type  of  learning  designed  for  a  specific  audience,  this  . 
study  has  indicated  more  research  is  warranted  in  the  area  of  aptitude 
capacities  of  the  learner  and  the  attributes  of  kinetic  media.    In  addition 

to  compositional  syntactic  placement  or  asymmetry  of  the  screen,  Zettl 
m 

(1973)  has  recognized  other  coding  systems  within  the  frame;    main  direction 
of  horizontal  and  vertical  orientations,  attraction  of  symbol  mass, 
figure-ground  relationships,  psychological  closure  and  vectors  or  directional 

- 
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lines  as  well  as  movement.  Kj^rup  (1977)  and  Metz  (1974)  have /identified 
syntaxes  beyond  the  level  of  the  shot  with  shots  forming  sequences, 


/ 


sequences  forming  syntagma,  and  syntagma  forming  the  whole  program.  The 
systematic  study  of  these  media  attributes  may  establish  a/sol id  structure, 
upon  which  instructional  programs  may  be  built,  especially  when  learner 
traits  are  used  in  the  measurement. 

■/"/ 

In  regard  to  learner  abilities,  more  fruitful  research  may  result 

m  "  /  ■ 

from  the  intercorrelational  aptitude  paradigm  of  Snow  (1980).    Snow  hi 

noted  that  fluid  ability  skills  (Gf)— a  constellation  consisting  of 

abstract  and  often  nonverbal  reasoning  tests  ana1  some  spatial  and  figural 

tests— should  relate  to  learning  outcomes  under  instructional  conditions 

that  are  in  some  sense  new,  unlike  those  that  the  individual  learner  has 

faced  in  the  past.    Ability  to  apply  learning  skills  crystal li/ed  previously 

(Gj.)  would  not  be  relevant  here,  but  ability  to  adapt  to  new/kinds  of 

learning  or  performance  requirements  (Gf)  would  be  relevant-    Snow  (1980, 

p.  39)  has  predicted: 

...that  as  an  instructional  situation  involves  combinations  of  a 
new  technology  (e.g.,  computerized  instruct ion  j6t  television),  new 
symbol  systems  (e.g.,  computer .graphics  or_ artistic  expression), 

  new  content  (e.g..  topological  mathematics  dv  astrophysics VT 

new  contexts  (e.g.,  independent  learning, 'collaborative  teamwork  in 
simulation  gameu),  Gf  should  become  important  .and  Gj.  less  important. 

Therefore,  Gf  tests  that  measure  to  a  greater  degree  the  kinds  of  assembly 

and  control  processes  needed  to  organize  on  a  short-term  basis  adaptive 

strategies  for  solving  novel  problems  should  be  included  in  studies  on 

interaction  effects  of  learner  and  media  attributes. 

With  the  increased  utilization  of  television  and  videotaped  programs 

in  education  to  reach  new  student  populations,  the  developed  learning 
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procedures  need  to  acknowledge  the  relationship  between  the  processing 

capacity  of  the  learner  and  the  processing  demands  of  the  media  task. 

Consequently,  educators  should  tailor  materials  to  fit  the  aptitude 

predispositions  of  learners.    In  so  doing,  they  may  promote  a  regard  fpr 

the  individual  that  is  made  possible  through  aptitude-sensitive  instruction, 

placing  emphasis  on  the  single  most  important  component  of  an  educational 

experience— the  learner.    This  study  has  taken  a  preliminary  step  into 

the  myrid  of  questions  regarding  the  impact  of  media  attributes  on  aptitude 

capacities  of  the  adult  learner.    The  results  of  this  exploratory  venture 

fostered  more  questions  than  answers.    Nevertheless,  this  initial  effort 

has  served  to  bring  into  focus  the  important  issue  of  learner  interaction 

with  media  attributes  for  education. 
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TABLE  i 

COMPOSITIONAL  SYNTACTIC  PLACEMENT  X  ABILITY  X  FIELD  ARTICULATION 
SUMMARY  OF  THREE-WAY  ANALYSIS  OF  VARIANCE 

> 


Source  of  Variation 

SS 

df 

MS 

* 

Compositional  -Syntactic 
Placement  (P) 

453.99 

2 

227.00 

.  19-92*** 

Ability  (A)      *  t 

.07 

1 

.or 

.01 

Field  Articulation  (F) 

71.04  . 

1 

71.04 

6.23* 

P  X  A 

4.38 

2 

2. 19 

.19 

P  X  F 

81.12 

• 

2 

40.56 

3.56* 

A  X  F 

111.22 

1 

r 

111.22 

9.76** 

P  X  A  X  F 

♦  52.82 

2 

?6.41 

2.32 

Error 

1595.32 

140 

11.40 

*£  <  .05 

**£  <  .01 

***£  <  .0001 

* 
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TABLE  2 

SIMPLE  MAIN  EFFECTS  ANALYSIS  OF  VARIANCE 


Source  of  Variation  SS  df  MS  •  F 


Compos i Clonal  Syntactic 


Placement  (P" 

453.99 

2 

.  227.00 

19.92 

* 

# 

F  it  F.  ' 

1 

385.82 

2 

192.91 

16.92** 

P  at  F 

u 

184.94 

2 

92.47 

.„  8.11** 

Ability  (A) 

.07 

1 

.07 

.01 

A  at  FT 

75.42 

1 

75.42 

6.62*' 

A  at  Fn  « 
D 

40.84 

1 

40.84 

3.58 

Field  Articulation  (F) 

71.04 

U 

• 

71.04 

6.23 

Fat  Ay 

3.47 

1 

3.47 

.30 

F  at  Al 

182.46 

1 

182.46 

16.01** 

F  at  PL  • 

2.96 

1 

2.96 

0 

.26 

Fat  Pc 

24.69 

1 

24.69 

2.17 

Fat  PR 

149.26 

1 

149.26 

13.09** 

P  X  A 

4.38 

2 

2. 19 

.19 

P  X  F 

81.12 

2 

40.56 

3.56 

A  X  F 

111.22 

1 

1 11.22 

9.76 

P  X  A  X  F 

52.82 

2 

26.41 

2.32 

Error  * 

1595.32 

140 

11.40 

*£  <  •  02 5         Note.    F  ratios  were  tested  at  the  */q  level  of 
*£  <  .001         *  significance f  where  q  equals  the  number  of 

variance  levels  (Kirk,  1968). 
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TABLE  3 


RESULTS  OF  SCHEFFE'S  S  METHOD  OF  ANALYSIS  FOR  COMPOSITIONAL 
SYNTACTIC  PLACEMENT  AT  FIELD  INDEPENDENCE 


Group     Fie Id- Independent      Field-Independent  Field-Independent 
Right  Left  '  Center 


24 


22 


27 


8.46 


4.05 


3.26 
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TABLE  4 

RESULTS  V    SCHEFFE'S  S  METHOD  OF  ANALYSIS  FOB  COMPOSITIONAL 
SYNTACTIC  PLACEMENT  AT  FIELD  DEPENDENCE 


Group       Field-Dependent         Field-Dependent  Field-Dependent 
Right  Left  Cencer 

a  26  28  25 

X  5.00     •  4.  56   U88 
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FIGURE  1  ' 

FIRST-ORDER  INTERACTION  OF  VISUAL  GROUPS  BY 
FIELD  ARTICULATION  ON  MEAN  GAIN  SCORES 
OF  PREDICTIVE  ABILITY 
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FIGURE  2 

FIRST-ORDER  INTERACTION  OF  PREDICTIVE  ABILITY 
BY  FIELD  ARTICULATION  ON  MEAN  GAIN 
SCORES  OF  VI8UAL  GROUPS 
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FIGURE  3 

SECOND-ORDER  INTERACTION  OF  VI3UAL  GROUPS  BY 
\     FIELD  ARTICULATION  BY  PREDICTIVE  ABILITY 
\   "'  ON  MEAN  GAIN  SCORES 
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OOWBinCIEB  OF  CUHRICDLDW  MATERIALS  CESSER  BBBCKBS  IN  TEftCBEft-HJDCKrKW 

ncnronac  ty  May  Lein  ho 

PURPOSE  MD  RA31GNKLE 

Die  social  and  economic  changes  of  the  20th  century  h  i  had  a 
profound  infect  upon  school  curriculum  and  methodology.  Greater 

» 

professional  responsibilities  have  been  placed  on  the  classroom  teacher, 
one  of  which  is  the  ability  to  integrate  into  a  learning  situation 
carefully  selected  instructional  materials,  such  competencies  as  finding, 
evaluating,  selecting,  utilizing,  and  ^-evaluating  curriculum  materials 
and  activities  are  considered  to  be  the  fundamental  prerequisites  of  a 
potential  teacher*  > 

Ho  make  certain  that  the  classroom  teachers  have  developed  these 
desired  knowledge,  skills,  and  understanding  in  the  program  of  professional 
education,  it  is  essential  for  those  who  are  responsible  for  the  education 
of  teachers  to  provide  the  prospective  teachers  with  quick  and  easy  access 
to  all  types  of  instructional  materials.   Arnett  (1965:3)  suggested: 

Only  as  the  pre-service  educational  period  provides  him 
with  these  materials  as  he  prepares  his  various  assignments 
of  his  instructional  planning,  can  he  learn  to  find-  the  ones 
he  raicfrt  use,  to  evaluate  them  as  to  their  potentiality  in 
the  educative  process,  to  select  what  will  be  proper  fox  his 
pupils,  to  utilize  them  so  that  tfcey  manifest  their  full 
potentialities,  and  finally  to  reevaluate  them  for  future 
use  or,  even,  for  future  rejection. 

The  idea  of  having  a  collection  of  textbooks,  samples,  of  curriculum 

guides,  research  and  teaching  units,  lesson  plans,  and  audiovisual 

materials  set  aside  emerged  as  early  as  in  the  1920's  (Kerr,  1979:5).  For 

many  years,  "curriculum  laboratory*  was  used  as  a  standard  term  to  identify 

this  type  of  facility.   In  recent  years,  many  names  have  appeared  including 

curriculum  center,  curriculum  library,  curriculum  materials  center, 
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educational  materials  oenter,  and  learning  resources  center/  to  name-  but  a 
few  (Povsic  and  Junion,.  1983:3).   In  this  study,-  the  term  generally  used 
was  "curriculum  materials  center"  and  the  professional  directly  isf  charge 

« 

of  the  center  was  entitled  "director." 

The  importance  and  justification  of  curriculum  materials  centers 
was  recognized  by  the  National  Council  *for  Accreditation  of  Teacher 
Education  (NCATE)  in  the  1960 *s  (Kerr,  1979:6).   Since  then,  the  curriculum 
materials  center  has  been  one  of  the  criteria  for  certification  of  the. 
teacher  education  program  in  schools  of  education.   Section  5.2  oC  the  1979 
NCATE  standards  for  the  Accreditation  of  Twifihftr  BfofiftUflP  Stated  that 

^^^^^  \ 

appropriate  materials  and  instructional  media  should  be  provided  and  thai  a 
materials  and  instructional  media  center  for  teacher  education  should  be 
maintained  either  as  a  part  of  the  library  or  as  die  or  more  separate  units 
to  support  the  teacher  educational  program  (NCATE,  1979:10). 

Despite  the  fact  that  curriculum  materials  centers  are  justified  as 
one  of  the  requirements  for  accreditation  of  a  college  of  teacher 
education,  and  most  colleges  and  universities  have  curriculum  materials  in 
specialized  collections,  there  are  still  no  standards  or  guidelines  set 
specially  for  them,  nor  "are  there  criteria  which  are  met  by  all  (Kerr, 
1979:10) .   The  curriculiza  materials  center  has  long  been  directed  on  a 
trial-and-error  basis,  with  tremendous  variation  in  priorities  among 
different  universities  (Houlihan,  1978:363) .   In  terms  of  the  staffing, 
there  is  not  only  ambiguity  regarding  the  leadership  role  of  the  staff,  but- 
there  are  also -differences  of  opinions  as  to  the  conzjetencies  and  skills 

»  * 

which  the  staff  should  possess  (James,  1963:101).  Several  studies  revealed 
that  no  standardized  pattern  has  been  stated  in  the  way  they  are  employed, 
their  qualifications,  and  the-  nufl»r  of  hours  their  services-are  available 


in  the  center  (Bhattarai,  1972:58) .   NOTE  (1979:24) ,  in  the  ftnfcrfB  for 
the  Jtoreditftti«     ThMhmr  BfljaattflPf  suggested  that  the  center 

should  be  directed  by  personnel  who  are  knowledgeable  about  instructional 
media  and  materials. 

The  purpose  of  this  study  was  to  identity  and  analyze  job 
competencies  deemed  essential  for  a  curriculum  materials  center  director  in 
teacher-education  institutions  as  perceived  by  selected  current  curriculum 
materials  center  directors  and  a  specified  group  of  educators,   The  extent 
to  which  specific  tasks  were  performed  by  the  curriculum  materials  center 
directors  was  investigated.   In  addition,  this  study  described  the 
characteristics  of  the  curriculum  materials  centers  and  their  directors  in 
teacher-education  institutions. 

By  identifying  the  tasks  that  a  curriculum  materials  center 
director  frequently  performed  and  the  job  competencies  essential  for  the 
director,  this  study  would  provide  guidance  to  the  administration  of 
teacher-education  institutions  when  recruiting  a  person  in  charge  of  the 
center,   current  curriculum  materials  center  directors  might  utilize  the 
results  of  the  study  to  identify  areas  of  need  for  continuing  education  and 
professional  growth.   Library  media  educators  might  find  this  study  useful 
while  designing  or  revising  curricula  to  educate  prospective  administrative 
personnel  with  a  goal  that  teacher-education  institutions  will  offer  better 
curriculum  materials  programs  to  meet  the  needs  of  faculty  and  students. 
FRQCEEUBE 

Two  questionnaires  were  developed,  one  of  which  was  designed  for 
curriculum  materials  cercer  Erectors?  the  other  was  designed  for  a  group 
of  educators  related  to  the  Uelds  of  educational  media  and  technology, 
library  and  information  science,  or  curriculum.  Each  questionnaire 
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contained  a  list  of  93  tasks.   The  93  tasks  were  tooufed  into  the  following 
10  categories:    (1)  Organization  Management,  (2)  personnel  Management,  (3) 
Materials  Selection  and  Evaluation,  (4)  Technical  Service,  (5)  Design  and 
Development,  (6)  Production,  (7)  Utilization  and  Consultation,  (8) 
Instruction,  (9)  Research,  and  (10)  Leadership  and  Professionalism, 
curriculum  materials  center  directors  were  instructed  to  r*te  each  task 
according  to  an  Importance  Scale  and  a  Frequency  Scale.   Rating  scale 
values  of  the  Importance  Scale  were:  (1)  Not  important,  (2)  Somewhat 
.important,  (3)  Moderately  Important,  and  (4)  Vtery  Important.  We 
respondents  expressed  their  opinions  regarding  hew  important  it  was  for  a 
curriculum  materials  center  director  to  be  competent  in  performing  a 
specific  task.    In  order  to  investigate  the  degree  of  frequency  a  specific 
task  was  performed  by  a  director,  the  participating  directors  were 
requested  to  rate  each  task  on  the  Frequency  Scale.   Hie  scale  values  were 
assigned  as  follows:  (1)  Never,  (2)  Seldom,  (3)  Occasionally,  and  (4) 
Frequently.    Instead  of  rating  both  scales,  the  professional  educators  were 
asked  to  weigh  each  task  only  under  the  Importance  Scale  and  reveal  their 
perceptions  of  jcb  competencies  that  a  curriculum  materials  center  director 
should  possess. 

Durirg  the  fall  of  1983,  the  questionnaires  were  sent  to  183 
curriculum  materials  center  directors  in  teacher-education  institutions  and 
100  selected  professional  educators  throughout  the  United  States. , 
Eighty-six  questionnaires  were  returned  by  the  educators,  83  ,(81  percent) 
of  which  could  be  used  for  data  analysis.  Of  the  1P"5  returns  .from  tjie 

\  f 

directors,  114  (62.30  percent)  responded  to  all*  items  in  the  instrument.  ^ 

Returned  questionnaires  were  tabulated  and  analyzed  *:o  answer  the  7 
questions  posed  in  the  study.  Distribution  frequencies  and  percentages  of 


responses  were  utilized  to  determine  personal  and  professional 
characteristics  of  the  respondents  and  current  status  of  the  responding 
curriculum  materials  centers.   In  analyzing  the  93  tasks,  frequencies  and 
percentages  of  the  alternatives  for  each  task  were  calculated  and  the  mean 
rating  of  each  item  was  computed.   Items  that  received  the  highest  rating 
from  at  least  51  percent  of  the  respondents  were  reported.   Bank  order  of 

w 

tasks  within  each  category  and  rank  order  of  all  tasks  were  obtained  by 
utilizing  item  means.   In  order  to  determine,  what,  if  any,  statistically 
significant  differences  existed  between  the  professional  educators  and 
curriculum  materials  center  directors  in  emphasis  placed  upon  individual 
competency  and  on  various  categories  of  competencies,  a  one-way  analysis  of 
variance  design  with  .05  level  of  significance  was  applied  to  analyze  the 
data.  *' 

* 

FINDINGS  .  ,  . 

Analysis  of  data  resulted  in  the  following  findings.   For  purpose 
of  clarity,  the  findings  were.grouped  into  the  following  sections:  (1) 
personal  information  concerning  curriculum  materials  center  directors,  (2) 
information  related  to  curriculum  materials  centers,  (3)  frequency  of  tasks 
performed  by  the5  directors,  (4)  importance  of  job  competencies  as  perceived 
by  the  educators  and  the  directors,  and  (5)  differences  of  the  two  groups 
in  emphasis  on  job  competencies. 

Personal  Information  Concerning  Curriculum  MatttfialB 
Cffltfil  Directors 

One  hundred  eighteen  directors  responded  to  questions  related  to 
personal  and  professional  characteristics  of  the  directors,  the  following 
results  were  indicated?' 

1.   Ohe1  majority  of  the  directors  w?re  female.   Of  the  118 
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respondents,  85  (72.03  percent)  were  women. 

2.  B»  greatest  meter  of  directors  surveyed  were  from  31  to  40 
years  of  age.   Tfre  second  largest  age  gtoup  was  from  51  to  60  years  of.  age. 

3.  There  was  considerable  variation  in  titles  assigned  to  persons 
in  charge  of  curriculum  materials  facilities.   Forty-nine  titles  were 
mentioned,  15  of  which  were  used  at  least  twice.   The  most  oannonly  used 
title  was  director.  e 

4.  The  majority  of  the  directors  were  Caucasian  in  ethnicity.  Of 
the  118  directors,  104  were  in  this  category. 

5.  Of  the  118  directors,  107  (90.68  percent)  were  at  or  beyond  the 

r*  • 

master's  leva}..   A  master's  degree  was  the  highest  earned  degree  for  80 
(67.80  percent)  directors.  .     •  , 

6.  The  responding  directors  indicated  a  wide  variety  of 
undergraduate  major  and  minor  fields  of  study.   The  most  prominent  master's 
major  amorg  83  responses  was  Library  Science,   Most  of  the  directors  with 
doctoral  degrees  were  in  Curriculum  and  Instruction,  Educational 
Technology,  and  Educational  Administration  arA  Supervision. 

7.  in  terms  of  professional  preparation,  a  significantly  large 
number  of  directors  had  library  science  preparation.   Of  the  118 
participating  directors,  80  had  more  than~27  semester  hours  of  library 
science  preparation. 

8.  Nearly  30  percent  of  the  directors  had  no  more  than  3  years  of 
experience  as  a  curriculum  materials  center  director.   On  the  other  hand, 
slightly  more  than  one-third  of  the  directors  had  more  than  10  years  of 
experience  as  a  curriculum  materials  center  director. 

9.  Participating  directors  indicated  that  they  had  more  work 
experiences  at  the  higher  education  level  than  at  any  other  level.  More 


than  one-half  of  the  directors  had  other  library  experience  than  curriculisn 
materials  center  director  experience.  -  t 

10.  the  most  prominent  professional  organization  that  directors 
joined  was  the  state  affiliate  of  the  American  Library  Association. 

Information  BclatCd  fcfl  QmflflllMB  Htttfilifllfl  flwitera 

« 

After  data  concerning  the  curriculum  materials  centers  in 
teacher-education  institutions  were  analyzed,  the  following  findings  were 
obtained: 

1.  Hie  greatest  number  of  institutions  surveyed  had  student 
enrollments  of  5,001  to  10,000. 

2.  Terms  used  to  describe  the.  participating  curriculum  materials 
facilities  did  not  have  uniformity.   The  term  used  most  frequently  was 
curriculum  materials  center.  ' 

3.  More  than  one-half  of  the  directors  held  full-time  positions  in 
curriculum  materials  centers. 

4.  The  majority  of  the  responding  curriculum  materials,  centers 
were  under  the  control  of  the  university  main  libraries. 

5.  Great  variation  existed^  regarding  supporting  staft.   A  vast 
majority  of*  the  responding  centers  indicated  part-time  student  assistants. 

6.  In  terms  of  annual  budget  for  purchasing  materials,  nearly  56 
percent  of  the  centers  had  budgets  of  no  more  than  $7,500.>  Nearly  80 
percent  of  the  centers  had  no  budget  for  temporary  use  of  materials. 

7.  Of -the  118  centers,  28  had  children  and/or  young  adult 
collections  of  5/001  to  10,000  items.   Thirty-nine  centers  had  1,001  to 

5.000  textbooks.,  Fifty-four  centers  had  curriculum  guide  collections  of 

1.001  to  5,000.  "jjjearly  62  percent  of  the  centers  indicated  no  more  than 
5,000  items  of  audiovisual  materials. 
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8.   The  most  ccnroon  production  equipment  installed  in  the  centers 
was  the  copy  machine, 

t 

Frequency  of  Tasks  Performed  by  the  Directors 

Of  the  93  tasks  investigated  in  the  present  study,  18  were 

performed  frequently  fay  at  least  51  percent  of  the  responding  directors. 

When  the  mean  for  each  task  was  calculated,  35  tasks  were  found  to  have 

means  in  the  range  of  "occasionally"  or  "frequently.*  Assisting  teachers 

and  students  in  locating  needed  materials  was  the  task  most  frequently 

performed  by  the  directors.   The  task  performed  least  frequently  was  to 

sponsor  student-made  productions  for  competition  at  fairs  or  conventions. 

Based  on  rank  order  of  the  10  functional  categories,  Utilization  and 

Consultation,  was  ranked  highest,  while  Production  was  ranked  lowest. 

Importance  of  Job  Competencies  as  Perceived  hv  the  Educators 
and  the  Directors 

After  data  gathered  from  the  Importance  Scale  were  analyzed,  49  job 
competencies  were  rated  as  being  very  important  by  at  least  51  percent  of 
the  educators,  while  46  were  perceived  to  be  very  important  by  at  least  51 
percent  of  the  directors.   Agreement  was  found  on  38  competencies.  The 
ability  to  plan,  organize,  and  administer  the  center  to  reach  goals  was  at 
the  top  of  the  list  considered  to  be  most  important  by  both  groups. 
Agreement  was  also  found  on  the  lowest  ranked  competency,    to  teach  library 
media  skills  on  demand  to' teachers  and  students.   As  for  the  categories  of 
job  competencies,  Leadership  &  Professionalism  was  ranked  highest,  while 
Production  was  ranked  lowest  by  Btth  groups. 
Differences  of  the  TVm  Croups  in  Emphasis  on  Job  Competencies 

Of  the  93  job  competencies,  one-way  analysis  of  variance  yielded  a 
significant  difference  in  44  itews  (47.31  percent).   The  educators  and  the 
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directors  differed  most  in  opinions  on  the  competency  of  deciding  whether 
curriculum  materials  should  be  produced  locally.  The  educators  rated  this 
competency  higher  in  importance  than  did  the  directors.    In  comparing  mean 
ratings  assigned  by  both  groups,  only  35  competencies  investigated  received 
higher  director  mean  ratings.   Significantly  more  items  in  the  categories 
of  Design  &  Development,  Production,  and  Research  had  higher  educators' 
means.    In  the  category  of  Technical  Service,  however,  more  competencies 
had  higher  directors'  means,  11  items  out  of  18.    In  terms  of  differences 
of  opinions  in  regard  to  categories  of  job  competencies,  one-way  analysis 
of  variance  revealed  significant  differences  in  7  categories  except 
Personnel  Management,  Technical  Service,  and  Utilization  &  Consultation. 
The  opinions  of  professional  educators  and  curriculum  materials  center 
directors  varied  most  in  the  category  of  Production. 
CONCLUSIONS  , 

Based  upon  the  findings  of  this  study,  the  following  conclusions 
were  drawn: 

1.   A  majority  of  the  curriculum  materials  center  directors  were 
library  science  oriented  in  terms  of  highest  degree,  master's  major  fields 
of  study,  professional  preparation,  work  experiences,  or  professional 
organizations  in  which  they  participated.   Specialities  or  qualifications 
related  to  educational  media  and  technology  or  curriculum  apparently  were 
not  widely  evident  among  the  curriculum  materials  center  directors  or 
administrators  of  teacher-education  inrti  tut  ions  as  prerequisites  for  this 
position.   Consequently,  certain  functions  that  curriculum  materials 
centers  ideally  could  perform  might  not  be  fully  fulfilled  or  recognized 
due  to  dire   ors'  lack  of  professional  preparation  or  background  in  certain 
areas. 
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2.  Hide  diversity  existed  among  the  curriculum  materials  centers. 
Common  characteristics  are  difficult  to  identify,  let  alone  any  standard 
pattern  or  uniform  policy.   Curriculum  materials  centers  appear  to  be 
operated  differently  in  every  respect  in  order  to  meet  the  individual  needs 
of  teacher-education  institutions. 

3.  A  majority  of  the  activities  in  which  curriculum  materials 
center  directors  were  frequently  engaged  .were  still  oriented  toward  those 
related  to  traditional  library  activities.   The  frequency  of  a  task 
performed  by  the  directors  was  closely  associated  with  directors'  opinions 
in  regard  to  the  importance  of  being  competent  in  performing  that  task. 
The  directors  tended  to  place  more  value  on  activities  in  which  they  were 
frequently  involved.   Utilization  and  Consultation,  Leadership  and 
Professionalism,  and  Organization  Management  were  among;  the  highest  ranked 
categories  in  task  performance  and  importance  rating.   On  the  other  hand, 
the  directors  were  minimally  involved  in  activities  related  to  Design  and 
Development,  Production,  or  Research.    Therefore,  the  active  and  leading 
role  a  curriculum  materials  center  director  can  play  in  Design  and 
Development,  Production,  or  Research  also  was  not  widely  accepted  as  being 
very  important  among  the  directors. 

4.  Even  though  provision  of  production  equipment  and  facilities  to 
assist  faculty  menfeers  or  st»:dents  in  producing  curriculum  materials  has 
bpen  proposed  for  years  as  one  of  the  important  functions  a  curriculum 
materials  center  shoulu  perform,  production  equipment  or  facilities  were 
not  very  popular  among  the  participating  curriculum  materials  centers. 
Different  arrangements  for  provision  of  production  equipment  or  facilities 
may  exist  in  those  teacher-education  institutions  with  no  production 
equipment  or  facilities  installed  in  the  curriculum  materials  centers. 
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5.  There  are  areas  of  agreements  between  the  curriculum  materials 
center  directors  and  professional  educators  in  regard  to  the  competencies 
considered  to  be  very  important  to  curriculum  materials  center  directors. 
The  38  competencies  that  the  majority  of  both  groups  considered  to  be  very 
important  represent  a  basic  set  of  common  qualifications  for  a  curriculum 
materials  center  director  that  can  be  useful  to  the  current  directors, 
library  media  educators,  and  administrators  of  teacher-education 
institutions. 

6.  There  are  also  areas  of  differences  between  the  participating 
directors  and  educators  concerning  the  competencies  essential  to  curriculum 
materials  center  directors.   On  the  one  hand,  the  competencies  that  a 
director  should  possess  as  expressed  by  the  professional  educators 
represent  ideal  goals  that  may  lead  to  betterment  of  the  profession.  On 
the  other  hand,  the  professional  ideals  may  not  be  consistent  with  what 
actually  happens  in  the  curriculum  materials  centers.   Discrepancies  may 
exist  between  the  professional  ideal  and  the  reality  of  the  curriculum 
materials  centers* 

RECOMMENDATION  f OR  FUTURE  STUDY 

Results  of  the  present  study  suggest  a  number  of  areas  foi.  further 
investigation.    The  following  are  recommended: 

w 

1.   Detailed  guidelines  and  standards  for  a  curriculum  materials 
center  in  teacher-education  institutions,  distinct  from  those  for  other 
settings,  should  be  developed.   A  written  statement  of  the  requisite 
competencies,  qualifications,  and  academic  preparation  a  curriculum 
materials  center  director  needs  to  possess  should  be  prepared  and  kept 
up-to-date.   Joint  efforts  to  achieve  this  goal  from  such  nation-wide 
professional  organizations  as  the  American  Library  Association  and  the 
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Association  for  Educational  Cocnunications  and  Technology  is  strongly 
recommended. 

2.  The  present  study  excluded  institutions  which  had  a  curriculum 
materials  center  but  did  not  have  a  professional  in  charge,  or  wtych  did 
not  have  a  curriculum  materials  center  as  defined  in  this  study.  A 
national  study  needs  to  be  conducted  to  include  all  the  institutions 
accredited  by  the  National  Council  for  Accreditation  of  Teacher  Education 
so  that  more  information  can  be  obtained  concerning  how  curriculum 
materials  are  provided  in  those  teacher-education  institutions  which 
arrange  different  access  for  faculty  members  or  students  to  curriculum 
materials. 

3.  A  need  exists  to  conduct  an  in-depth  study  as  to  the 
organization,  purposes,  functions,  staffing,  and  services  of  existing 
curriculum  materials  centers.   Evaluative  criteria  should  be  developed  so 
that  an  evaluation  type  of  study  could  be  conducted  concerning  curriculum 
materials  centers  and  the  competency  level  of  curriculisn  materials  center 
directors  when  compared  to  the  tasks  performed  by  the  directors. 

4.  A  study  should  be  conducted  to  investigate  how  curriculum 
materials  centers  are  used  by  faculty  members  and  students.   Needs  of 
faculty  members  and  students  in  regard  to  services  and  programs  of 
curriculum  materials  centers  also  should^  be  examined. 

5.  A  study  should  be  conducted  to  examine  how  production  equipment 
and  facilities  are  provided  in  the  teacher-education  institutions  if  they 
are  not  installed  in  the  curriculum  materials  centers.   Advantages  and 
disadvantages  of  different  arrangements  should  be  investigated. 
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I  believe  imagery  training  is  an  important  aspect  to  improve  learning. 
Imagery  training  involves  the  following  activities! 

1.  leaching  students  to  visualize  their  thoughts; 

2.  Helping  students  to  make  external  representations  of  their 
internal  thought  processes i 

3.  Helping  students  to  transfer  their  imagery  training  to  solving 
visual  and  verbal  problems. 

Traditionally,  teachers  do  not  use  imagery  in  the  classroom.  Teaching 
imagery  to  students  may  help  them  gain  creative  insights ,  organize  thoughts 

and  solve  problems.    Students  also  use  imagery  to  organize  information  and 

i 

simplify  ideas'.    Imagery  is  the  ability  to  create  images  of  the  mind  to 
understand,  learn  and  see  experiences. 

Training  studer  s  to  use  imagery  in  their  learning  is  important.  Many 
teachers  emphasize  activities  that  involve  verbal,  analytical  thought  and 

ignore  imagery  learning.   Two  separate  studies  were  conducted  to  train 

< 

students  to  image  in  order  that  they  might  increase  their  imagery  skills. 
It  was  hypothesized  that  students  who  were  given  training  in  imagery,  would 
transfer  those  imagery  skills  for  solving  visual  puzzles  and  verbal 

t 

problems  to  a  graater  degree  than  those  who  did  not  receive  imagery 
training.  ! 

In  the  first  study  seventy-eight  (78)  graduate  students  volunteered  to 
participate.    The  experimental  group  (N  ■  29)  was  given  a  lecture  and  slide 
presentation  designed  to  teach  subjects  about  imagery.    The  lecture  with 
slides  included  a  definition  of  imagery,  ways  for  students  and  teachers  to 
use  imagery  in  the  classroom,  examples  of  learning  with  imagery  and 
exercises  in  solving  visual  puzzles  through  imagery.    Both  the  experimental 
and  control  groups  (N  »  49)  were  given  a  Visual  Puzzles" Test,  compiled  from 
various  puzzle  books.    This  instrument  was  used  to  measure  the  ability  of 

t 
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the  subjects  to  solve  visual  puzzles.  The  test  consisted  of  fourteen  items 
and  a  score  was  determined ' by  the  sum  of  the  items  correctly  answered. 

T- tests  were,  conducted  between  the  experimental  and  control  groups  and 
between  males  and  females  on  their  score  on  the  Visual  Puzzles  Test.  The 
t-tests  revealed  significant  differences  between  the  experimental  and 
control  groups  (t  ■  4.85,  df  ■»  76,  p  <  .001).    Due  to  a  significant 
homogeneity  of  variance ,  the  pooled  variance  estimate  was  used.    There  were 
no  significant  sex  differences  on  the  Visual  Puzzles  Test.    The  mean  for' 
the  control  cv  *up  (N  ■  49)  was  7.6  and  for  the  experimental  group  (N  »  29) 
the  mean  was  10.4. 

a! 

Trie  results  of  this  study  show  that  imagery  training  does  facilitate 


transfer  to  solving  visual  puzzles.    The  Visual  Puzzles  Test  can  be  easily 
duplicated  by  teachers  and  researchers  by  using  the  many  puzzle  and  game 
books  available.  / 

In  the  second  study  a  total  of  one  hundred  and  thirty-three  (133) 
graduate  students  volunteered  to  participate.    The  treatment  group 
consisted  of  seventy-nine  (79)  subjects  and  the  control  group  had 
fifty-four  (54)  subjects.    The  treatment  group  again  received  a  slide  and 
lecture  presentation  on  imagery  training.    This  time  the  treatment  and 
control  groups  were  given  the  Visual  Thinking  for  verbal  Problems  Test  v 
(VTVP).    This  instrument  was  used  to  measure  the  ability  of  the  subjects  to 
solve  verbal  problems  uoing  imagery  techniques.    The  Visual  Thinking  for 
verbal  Problems  Test  was  compiled  from  various  game  books.    The  test 
consisted  of  eight  (8)  items  and  a  score  was  determined  by  the  sum  of  the 
items  correctly  answered. 

T-tests  "were  performed  between  the  treatment  and  control  groups  and , 
between  the  males  and  females  on  their  score  of  the  Visual  Thinking  for 
verbal  Problaas  Test  (VTVP).    The  t-tests  revealed  significant  differences 


m 


between  the  treatment  group  and  the  control  group  (t  ■  10.25,  df  «  123,  p  < 
•001).    There  were  no  significant  sex  differences  on  the  Visual  Thinking 


Again,  the  results  indicate  that  if  subjects  are  given  imagery 
training,  they  will  he  able  to  use  imagery  for  solving  verbal  problems.  It 
is  apparent  that  the  treatment  was  effective.    I  believe  that  teachers  need 
to  provide  opportunities  for  imagery.    I  also  believe  that  these  two 
studies  shew  the  importance  of  allowing  students  to  participate  in  the 
problem  solving  process.    I  was  able  to  accomplis'.i  student  participation  by 
asking  them  to  represent  externally  their  thoughts  on  the  instruments 
provided  so  that  they  could  share  their  imagery  with  others.  Further 
research  and  theory  on  visual  thinking  can  be  found  in  the  references. 


n  for  the  control  group  (N  *  54)  was  3.83. 


T»  mean  for  the  treatment  group  (N  ■  79)  was 
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Introduction  to  the  Study 

• » 

The  inclusion  of  visual  illustrations  in  educational 
textbooks  is  a  longstanding ,  practically  universal  practice. 
It  can  be  determined  from  even  the  most  rudimentary 
examination  of  currently  used  texts  in  both  public  schools 
and  higher  education  that,  regardless  of  subject  or  level 
both  publishers  and  educators  seek  texts  which  include  a 
variety  of  visual  representations.     In  light  of  the  heavy 
reliance  upon  visuals  in  textbooks  it  seems  appropriate  .that 
there  would  be  empirical  data  to  support  this  practice.  » 
Accordingly,  several  studies  have  been  conducted  which 
attempt  to  establish  the  relationship  between  pictures  and 
accompanying  text.    However,  to  date  research  in  this  area  ~ 
has  been  non-conclusive.    There  are  ss  many  studies  that 
indicate  a  lack  of  effect  or  a  detrimental  effect  from 
illustrations  in  text  as  there  are  that  indicate  a  positive 
effect  (Duchastel,  1980). 

It  appears  that  the  most  valuable  information  gained 
from  the  majority  of  studies  heretofore  conducted  concerning 
the  relationship  of  illustrations  and  text  is  that  there  can 
be  no  generalizations  made.    One  reason  for  this  lack  of 
conclusive  evidence  seems  to  be  the  inability  to  consider 
illustrations  as  complex,  multivariate  media.    The  type  of 
illustration,  its  relatioaship  to  the  text,  its  physical 
characteristics,  its  placement  in  the  text,  and  the  purpose 


f 
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of  its  existence  in  the  learning  situation  are  among  the 
variables  that  will  have  a  profound  bearing  on  its 
effectiveness.    ?s  noted  by  Schramm  (1977),  the  differences  • 
within  a  medium  are  not  smaller  than  those  between* media . 

That  there  are  differences  found  within  various  > 
illustrations  is  well  known  (Goodman,  1976;  Salomon,  1979; 
Schramm,  1977).     it  appears  that  these  differences  are 
manifested  in  an  interrelationship  of  message,  media 
attributes  and  environment.    The  problem  of  identifying 
those  attributes  of  illustrations  that  help  increase 
learning  from  textual  matter  in  various  situations  is  one  of 
the  unanswered  questions  in  this  realm  of  research.    Yet,  to 
date  research  has  touched  only  lightly  on  an  examination  of 
specif 3b  attributes  of  illustrations  as  they  relate  to  text 
(Brody,  1982). 

Salomon  (1978)  asserts  that  because  they  are  composed 
of  a  complex,  flexible  variety  of  attrit  i  «s,  different 
media  can  be  used  for  a  variety  of  instructional  endeavors 
on  a  variety  of  levels.    Following  Schramm's  (1977) 
statement  concerning  differences  within  a  medium,  Salomon's 
principle  could  also  apply  to  the  same  medium  used  under 
different  circumstances.     In  other  words,  the  same  medium 
could  be  used  for  a  variety  of  instructional  tasks  and 
result  in  a  variety  of  learning  outcomes,  based  upcn  the 
circumstances  of  its  use.    Nevertheless,  most  research  tends 
to  examine  the  illustration  as  a  whole  rather  than  as  a 
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complex0  combination  of  attributes.    In  order  to  assess  the 
value  of  an  illustration  as  an  instructional,  tool  when  it  is 
used  in  conjunction  with  textual  matter ,  each  of  the 
attributes  found  in  the  illustration  and  its  relationships 
with  other  attributes  must  be  examined. 

In  order  that  an  accurate  assessment  of  effectiveness 
be  placed  on  an  illustration  used  in  conjunction  with  text, 
it  is  first  necessary  to  determine  the  instructional 
function  that  illustration  is  performing.    Only  after  this 
determination  is  made  can  a  comparison  of  effectiveness 
between  pictorial  formats  occur.    An  illustration  used  in 
conjunction  with  text  with  no  consideration  as  to  what 
instructional  role  it  is  intended  to  serve  might  very  well 
prove  no  more  effective  than  no  illustration;  in  fact,  it 
might  prove  detrimental  to  pedagogical  qualities  of  the 
text.    But  the  fact  that  much  research  shows  a  positive 
effect  from  illustrations  suggests  that  if  an  illustration 
serves  an  instructional  function  appropriate  to    he  intended 
instructional  outcome,  it  has  value  as  a  textual  supplement. 

The  ability  of  an  illustration  to  serve  an  appropriate 
function  is  dependent  upon,  among  other  things,  the 
attributes  present  in  the  illustration  and  the  relationship 
between  the  illustration  and  the  text.    Empirical  studies 
have  established  that  certain  attributes  of  illustrations 
influence  their  instructional  effectiveness  (Levie  and 
Lentz,  1982).    Matching  attributes  to  instructional 
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functions  can  therefore  be  considered  one  essential  step  in 
establishing  a  data  base  for  decisions  about, 
illustration-text  relationships. 

Recently,  studies  have  been  conducted  to  begin  the  task 
of  matching  attributes  of  illustrations  to  specified 
instructional  functions.    Much  more^ information    3  needed 
before  effective  utilizatibn  of  illustrations  in  textbooks 
can  be  assured..  The  present  study  is  a  further  test  of  the 
attribute-function  relationship  of  visual  illustrations  used 
with  text.    It  examines  the  ef fectivenesss  of  illustrations 
providing  analogical  representation  and  illustrations 
providing  literal  representation  in  serving  two  specific 
-  ,»        instructional,  functions. 

"Si 

The  primary  hypotheses  of  the  study  are  that 
illustrations  providing  analogical  representation  better, 
serve  the  instructional  function  of  visually  clarifying 
abstract  or  nonphenomenal  information,  and  that 
illustrations  providing  literal  representation  better  serve 
the  function  of  identifying  physical  properties  of 
phenomenal  information.,    The  distinction  between  phenomenal 
and  nonphenomenal  information  is  4he  difference  between 
information  that  does  or  does  not  have  a  tangible  .existence 
that  can  be  recorded.    Nonphenomenal  information  has  no 
tangible  existence  or  is  too  large,  too  small,  too  distant 
or  too  transient  to  be  recorded  (Knowlton,  1966).  For 
example,  voltage,  which  is  defined  as  electromagnetic  force 
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and  is  derived  by  multiplying  current  by  resistance,  has  no 
tangible  existence  and  is  therefore  nonphenomenal • 
Phenomenal  information  has  s  tangible  existence  that  can  be 
recorded,    A  resistor ,  which  slters  voltage  in  a  circuit,  is 
composed  of .tangible  substances  such  as  metal  wire  and 
plastic,  and  therefore  is  phenomenal. 

In  terras  of  textbook  utilization,  the  hypotheses  of  the 
study  are  that  if  an  intended  instructional  function  is  to 
clsrify  nonphenomenal  information,  an  illustration  that 
provides  an  analogical  representation  is  more  likely  to  be 
effective.    If  the  intended  instructional  function  is  to 
identify  properties  of  phenomenal  information,  an 
illustration  that  provides  a  literal  representation  is  more 
likely  to  be  effective.    Analogical  illustrations  are 
defined. for  this  study  as  being  functionally  as  well  as 
physically  different  from  literal,  or  realistic, 
illustrations.    An  illustration  providing  analogical 
representation  is  one  in  which  a  visual  is  used  as  a 
reference  to  information  that  is  not  literally  identified 
by,  but  rather  conceptually  represented  by,  the  visual.  Its 
features  usually  do  not  resemble  the  features  of  the 
information  it  represents.    This  type  of  illustration  ir> 
effectively  used  when  the  information  it  illustrates  is 
nonphenomenal.    For  example,  an  illustration  providing 
analogical  representation  could  depict  the  effect  of 
resistors  on  voltage  in  a  circuit,  even  though  voltage  is 
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ponphenomenal • 

An  illustration  providing  a  literal  representation ,  on 

the  other  hand,  is  a  more  salient  representation  of  real 

phenomena,  usually  because  it  pictorial ly  resembles  such. 

•a 

Although  all  illustrations  depart4  in  some  -degree  from  real 

v  f 

objects,  for  esample.  in  aspects  such  as  dimensionality  or 
size,  an  illustration  possessing  a  physical  resemblance  to 
an  object 'establishes  a  relatively^ more  literal 

representation  of^he  object  than  doe  a  an  illustration  not 

j 

possessing  a  physical  resemblance*.    In  other  words,  if  the 
object  in  an  illustration  can  be  identified  by  the  viewer  as 
that  object,  the  illustration  is  providing  a  literal 
representation.    An  illustration  physically  resembling  a 
resistor  would  provide  literal  representation.    This  type  of 
illustration,  often  referred  to  as  realistic,  has 
traditionally  been*  considered  instruct ionally  effective. 
Recently,  resemblance  end  realism  have  been  questioned  as 
prpper  criteria  for  judging  ^he  appropriateness  of  visual 
materials.    Salomon  (1979)  asserts  that  resemblance  to  a 
real  object  in  visuals  is  at  best  superficial,  and  that  the 
real  meaning  .behind  any  communication  is  what  is  attributed 
to  it  by  way  of  mental  processes  rather  than  *a  property,  of 

c 

the  message  itself.    Thus,,  for  increasing  comprehension,  the 
illustration  providing  analogical  representation,  might 
better  illustrate  information  that  would  be  difficult  or 
impossible  to  illustrate  literally,  while  the  illustration 
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providing  literal. representation  night  sore  effectively  t 
supplement  an  expository  description  of  phenomenal 
information. 

r 

•    experimental  Procedures 
Following  a  pilot  study  to  determine  validity  and 
establish  parameters  of  the  experiment,  the  hypotheses  were 
tested  by  assigning  the  reading  of  college  level  textual  - 
excerpts  to  two  groups  of  college  students.  *  The  groups  each 
read,  two  passages,  one  utilizing  an  illustration  providing 
analogical  representation  of  nonphenomenal  information 
discussed  in  the  passage,  the  other  utilizing  an 
illustration  providing  literal  representation  of  phenomenal 
information  discussed  in  the  passage.    While  group  one  read 
a  passage  utilizing  an  illustration  depicting  an  analogical 
representation,  group  two  read  the  same  passage  utilizing  an 
illustration  depicting  a  literal  representation.  This 
procedure  was  reversed* for  the  second  passage.    Thus,  both 
groups  rerd  twb  passages,  each  one  utilizing  an  illustration 
with  a  different  depiction.    Results  of  subsequent 
comprehension  tests  were  analyzed  to  determine  the  relative 

4 

effects  of  the  illustrations  on  comprehension  of  phenomenal 

and  nonphenomenal  information  within  the  passages. 

The  hypotheses  were  tested  on  90  rsndomly  selected  male 

e 

and  90  randomly  selected  female  college  undergraduates 
students.    Then  each  of  the  two  90  subject  groups  was 


% 


^  .    r  Page  8 

s  * 

equally  divided  into  ,jtwo  treatment  groups*    Thus,  equal 
numbers  of  subjects  were, represented  in  each  of  the_/our 
groups.  •  * 

Since  the  study  is  a  test  of  comparative  comprehension 
effects,  it  is  necessary  to^remeve  as  many  other  variables  * 
as  possible  from  the  population.    Thus,"*a  groyp  of  college 
students,  who  can  be  assumed  to.be  skilled  readers,,  will v 
allow  a  more  accurate  assessment  of  the  Variables  tested,-, 
since  inability  to  perform  well  on  a  comprehension  test 
could  not  be  attributed  to  the  subject's  inability  to  read.. 
Two  expos itorv  prose  passages  taken  from  college  fevel 

texts  were  used  in  the  study,  \ne  concerning  photosynthesis 

i 

m 

in  plants  and  one  concerning  the  structure  and  function  6t 
human  Muscles.    Both  passages  were  selected  from  monographs 
currently  or  recently  used  as  college  level  supplemental 
texts,  to  insure  that  the  passages  qualified  as  college 
level  expository  pieces. 

When  testing  with  higher  level  subjects  and 
curriculum-based  material,  it  is  many  times  difficult  to 
distinguish  what  is  learned  from- what  is  already  known.  It 
was  therefore  decided  to  use  passages  that  would  contain 
information  commonly  attainable,  but  probably  not  overly 
familiar  to  college* undergraduate*,  as  dete*m!*hed  by  a 
pretest  survey.    The  passages  were  also  selected  because  of 
the  high  level  of  technicality  and  density  cf  information 

contained  in  a  short  space  as  well  as  the  presence  of- both 

a 
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0  • 

•  * 

per formed  on  the  gathered  data,  oqp  acting  as  a  replication 
study  to  the  other;    The  passage  variable  was  not 
-incorporated  into  a  single  ANOVA  so  that  it  would.be 
possible, to  isolate  and  emphasize  predicted  interactions 
between  other  variables,  and  because  this  experiment  is  not 

•  41  S 

a  comparison  of  comprehension  of  the  two  passages  per  se. 

Any  possible  loss  of  information  occasioned  by  not- testing 

this  interaction  is  offset  by  the  increase  in  power  and 

ability  to  generalize  brought  about  by  the  replication 

aspect  of  the  study.  * 

The  analysis  of  variance  tests  devide  the  groups  by 

task  and  treatment  for  each  passage.    A  third  division, 

•  * 
gender  of-  subjects*  was, used  to  test  for  any  possible 

0  r. 

•  / 

interaction  between  task  and  gender  or  treatment  and  gender 

V 

Thus,  the  three-way  design  incorporates  type  of 
illustration,  type  of  question  and  gender  variables  into  a 
factorial  analysis.  & 

* 

* 

Results 

i 

Comprehension  performance  tests  for  each  of  the 

t 

passages  were  Statistically  analyzed  separately.    The  . 

» 

passage  concerning  photosynthesis  in  plants  was  assessed 
first .    Results  were  obtained  concerning  the  differences 
between  and  within  the.  blocked  groups  of  subjects.  The 
a;  s  of  variance,  shown  in  Table  1,  identifies  the 

inw. action  between  treatments  and  tests  as  significant, 
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F(l,176)  •  83.34,  p<.«. 

Table  1 

Photosynthesis  in  Plants  Passage 
Analysis  of  Variance 
_  N  ■  180 


Source 

SS 

df 

MS 

r. 

petween  Groups 

264 

lP 

Treatments 

1.61 

1 

\ 

1.61 

1.08- 

Gender 

0.41 

\ 

i  \ 

0.41 

.28 

Treatment  X  Gender 

0.17 

i  x 

0^17 

.11 

Groups  w/Treat,Gen 

261.31 

176 

1.49 

Within  Croups 

190.50 

180 

Tests 

0.41 

1 

0.41 

mm  m    »  • 

•  56 

Treatments  X  Tests 

60.84 

1 

60.84 

83.34* 

Tests  X  Gender 

0.70 

1 

0.70 

.96 

Treat  X  Test  X  Gender  .0.41 

1 

0.41 

.56 

Tests  X  Groups  w 
Treatments  X  Gender 

129.14 

* 

Total 

454.50 

359 

*  p<.01 

If 

As  illustrated 

in  Table 

1,  there  were 

no  significant 

differences  for  the  main  effects  of  treatment,  gender  and 
tests.    There  was  a  significant  difference  for  the  treatment 
x  test  interaction,  which  reflects  the  ability  of  subjects 
to  respond  correctly  to  different  types  of  questions 
depending  on  the  type  of  illustration  provided  in  the 
passage.    All  other  interactions  were  analyzed  as 

i 
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nonsignificant.  , 

The  data  supports  the  rejection  of  both  the  null 
hypotheses  of  this  study*     It  indicates  that  .there  is  a 
significant  difference  in  ability  of  subjects  to  respond 
correctly  to  questions  of  a  nonphenomenal  and  a  phenomenal 
nature  depending  upon  the  type  of  visual  illustration 
utilized  in  an  expository  passage.    Specifically,  in  a 
textbook  passage  concerning  photosynthesis  of  plants,  more 
questions  of  a  nonphenomenal  nature  were  answered  correctly 
by  subjects  who  read  the  passage  utilizing  an  illustration 
providing  analogical  representation  than  by  subjects  who 
read  the  same  passage  utilizing  an  illustration  providing 
literal  representation.    Inversely,  those  students  reading 
the  passage  utilizing  the  illustration  providing  literal 
representation  answered  more  questions  of  a  phenomenal 
nature  correctly  than  did  those  reading  the  passage 
utilizing  the  illustration  providing  analogical 
representation. 

The  data  derived  from  the  replication  test  performed  on 
the  passage  concerning  the  parts  and  functions  of  human 
muscles  supports  the  results  of  the  photosynthesis  passage. 
Again,  results  were  obtained  concerning  the  differences 
between  and  within  groups  of  subjects.    The  analysis  of 
variance,  shown  in  Table  2,  again  identifies  the  interaction 
between  treatments  and  tests  as  significant,  F (1,176)  - 
77.80*  p>.«l. 
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Table  2 

* 

Parts  and  Functions  of  the  Human  Muscle 
Analysis  of  Variance 
H  -  180 


Source 

SS 

df 

MS 

F 

Between  Groups 

308.87 

179 

Treatments 

0.62 

1 

0.62 

.35 

Gender 

0.62 

1 

0.62 

.35 

Treatments  X  Gender 

0.23 

1 

0.23 

.13 

Groups  w/Treat ,Gen 

307.40 

176 

1.75 

Within  Groups 

175.50 

180 

Tests 

0.02 

1 

0.02 

.03 

Treatments  X  Tests 

53.68 

1 

53*68 

77.80* 

Tests  X  Gender 

0.01 

1 

0.01 

.01 

Treat  X  Test  X  Gender  0.22 

1 

0.22 

.32 

Tests  X  Groups  w/ 
Treatments  X  Gender 

121.57 

176 

0.69 

Total 

484.37 

359 

*  p<.01 


Again  the  analysis  of  variance  indicates  a  lack  of 
significant  difference  for  main  effects  of  treatment ,  gender 
and  tests,  and  for  all  interactions  with  the  exception  of 
the  treatment  x  test  interaction.    The  results  of  the 
replication  test  support  the  rejection  of  the  null 
hypothesis  reported  from  the  first  test.    Again,  there  is  a 
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significant  difference  in  ability  of  subjects  to  respond 
correctly  to  questions  of  a  no n phenomenal  and  a  phenomenal 
nature,  depending  upon  the  type  of  visual  illustration 
utilized  in  conjunction  with  the  text. 

Lack  of  any  significant  difference  within  groups  or  of 
any  interaction  other  than  that  between  treatment  and  test 
in  either  analysis  of  variance  indicates  that  in  each 
situation  the  illustration  was  performing  a  specific 
instructional  function  that  was  not  being  served  by  the 
other  type  of  visual  representation. 

Discussion  and  Recommendations 

The  data  generated  in  this  study  support  one  of  the 
basic  premises  of  the  functional  approach  to  research  on 
illustrations;  functions  served  by  illustrations  must  be 
viewed  in  terms  of  specific  and  precise  instructional  roles 
rather  than  more  general  instructional  goals  or  outcome 
statements  (Brody,  1983).    In  this  study,  illustrations  were 
selected  to  serve  two  specific  functions,  with  the  intent  of 
the  selection  and  subsequent  utilization  being  to  aid  in  the 
achievement  of  an  instructional  outcome.    Specifically,  one 
illustration  was  selected  to  identify  properties  of 
phenomenal  information  introduced  in  an  expository  prose 
passage  and  one  illustration  was  selected  to  clarify 
nonphenomenal  information  introduced  in  an  expository  prose 

4h0  ' 
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passage.    These  are  two  examples  of  instructional  functions 
which  can  be  served  by  illustrations,  viewed  in  terms  of 
precise  and  specific  instructional  roles.    The  expected 
instructional  outcome  to  be  aided  by  these  functions  was 
comprehension  of  the  prose  passages  read  in  conjunction  with 
the  illustrations. 

Results  of  comprehension  tests  from  both  passages 
indicate  that  overall  comprehension  scores  on  the  tests  were 
similar  regardless  of  the  type  of  illustration  utilized. 
This  indicates  that  the  presence  of  an  illustration  has  a 
similar  effect  on  overall  comprehension  of  the  passage.  It 
also  supports  the  long  established  positive  correlation 
between  the  effectiveness  of  an  illustration  and  its 
relevancy  to  the  text  (Halbert,  1943). 

More  important  for  this  study,  however,  is  the 
indication  that  the  illustrations  served  specific 
instructional  functions.    The  group  that  read  the  passage 
with  an  illustration  which  served  the  function  of  J 
identifying  properties  of  phenomenal  information  did 
significantly  better  on  comprehension  of  that  type  of 
information  than  did  the  group  reading  the  passage  with  an 
illustration  serving  another  function.    Conversely,  the 
group  reading  the  passage  with  an  illustration  which  served 
the  function  of  clarifying  nonphenomenal  information  did 
significantly  better  on  comprehension  of  that  information 
than  did  the  other  group.    Thus,  it  can  be  concluded  that, 
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while  both  illustrations  were  assisting  in  the  overall 
comprehension  of  the  passage,  they  served  different 
functions  to  achieve  this  assistance ,  by  addressing 
different  types  of  information.    Analysis  of  the  data 
indicates  that  different  types  of  information  were  more 
effectively  comprehended,  depending  upon  the  illustration 
used  with  the  passage. 

Based  upon  the  results  of  the  empirical  tests,  it 
appears  that  there  is  not  a  significant  difference  between 
the  ability  of  male  and  female  students  to  utilize  the 
illustrations  for  the  specified  instructional  functions  of 
this  study.     It  could  therefore  be  concluded  that  for 
college-aged  students,  no  gender  distinction  is  necessary 
when  selecting  illustrations  to  fulfill  instructional 
functions.  A 

Thus,  me  relationship  between  the  instructional 
function  served  by  an  illustration  and  the  instructional 
outcome  aided  by  that  function  can  be  compared  to  the 
relationship  between  "means"  and  "end".    Functions  provide 
the  means  of  acnie.ing  instructional  ends.    Further,  the 
success  or  failure  of  an  illustration  to  serve  an 
instructional  function  depends,  among  other  things,  upon  the 
appropriate  selection  of  an  illustration  for  that  function 
and  the  effective  implementation  of  that  function  in  the 
text. 

Data  derived  from  this  study  concerning  selection  of 
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illustrations  to  serve  specified  instructional  functions 
indicates  that  there  is  an  interaction  between  the  type  of 
representation  provided  by  the  illustration  and  the 
instructional  function  served  by  the  illustration. 
Specifically,  an  illustration  providing  analogical 
representation,  which,  as  defined  in  this  study  acts  as  an 
abstract  representation  of  information,  helps  to  clarify 
abstract  or  otherwise  nonphenostenal  information.  *  Similarly, 
an  illustration  providing  literal  representation,  which 
usually  denotes  a  salient  physical  resemblance  to  phenomenal 
objects,  helps  to  identify  phenomenal  information.    Thus,  it 
appears  that  achievement  of  different  instructional 
functions  may  require  the  use  of  different  types  of 
illustrations  in  some  cases. 

Recommendations  for  Further  Study 

Several  recommendations  for  further  investigation 
concerning  the  functions  that  can  be  served  by  illustrations 
in  text  can  be  made.    Initially,  the  results  of  this  study 
support  the  need  for  more  extensive  investigation  concerning 
illustrations  serving  instructional  functions  in 
relationship  to  textual  matter.    Tests  similar  to  this  one 
need  to  be  conducted  with  students  on  various  educational 
levels.    Information  as  to  what  levels  can  effectively  use 
illustrations  providing  analogical  representation,  for 
example,  can  add  significantly  to  under £ tanding  of 
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functional  services  of  illustrations  as  well  as  many  related 
areas  of  concern.    Another  area  of  investigation  concerns 
the  academic  subjects  introduced  H  the  textual  passages. 
Illustrations  providing  analogical  representation  and  those 
providing  literal  representation  should  be  created  for 
subject  disciplines  outside  the  pure  sciences,  to  increase 

o 

ability  to  generalize  and  extend  understanding  of 
circumstances  under  which  these  representational  types  of 
illustrations  can  effectively  serve  instructional  functions. 
Assessments  should  be  made  as  to  which  subject  disciplines 
lend  themselves  to  these  types  of  illustrations  serving 
these  functions. 

There  is  also  a  need  to  conduct  studies  concerning  the 
use  of  different  types  of  representations  serving  functions 
identical  or  similar  to  the  ones  served  in  this  study.  For 
example,  it  would  be  valuable  to  know ^jether 
representations  other  than  those  providing  analogical 
representation  will  effectively  clarify  nonphenomenal 
information.    This  should,  of  course,  pe  conducted  with  a 
wide  variety  of  representational  forms.    Closely  related 
studies  using  a  variety  'of  representational  formats  which 
serve  other  instructional  functions  than  the  ones  utilized 
in  this  study  are  also  needed. 

Tests  could  be  constructed  to  see  whether  two 
illustrations,  each  serving  a  different  function  within  a 
passage,  would  contribute  more  toward  the  achievement  of 
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instructional  outcomes  than  one  illustration  serving  one 

» 

function.    The  basis  of  this  hypothesis  would  be  that 
instructional  outcomes  cannot  necessarily  be  achieved  in 
their  entirety  through  achievement  of  one  function,    in  many 
cases,  a  number  of  different  functional  operations,  both 
pictorial  and  nonpictorial ,  may  be  needed  to  achieve  an 
instructional  outcome. 

It  would  also  be  relevant  to  test  whether  a  number  of 
different  functions  could  be  served  by  the  same 
illustration.    For  example,  the  illustration  serving  the 
function  of  identifying  phenomenal  information  might  also 
have  served  the  function  of  emphasizing  a  point,  providing 
examples,  or  directing  attention. 

Studies  will  also  be  necessary  to  assess  the 
effectiveness  of  illustrations  serving  functions  with 
literary  forms  other  than  expository  prose.    This  will 
involve  the  application  of  various  representational  types  to 
various  functional  operations  for  each  of  the  literary  forms 
investigated. 

In  short,  this  study  is  but  one  of  many  that  will 
result  in  a  better  understanding  of  illustrations  serving  as 
instructional  tools  when  used  in  conjunction  with  textual 
Matter.    The  conclusiveness  of  the  result  -  of  this  study 
both  necessitates  and  facilitates  further  investigation  into 
this  aspect  of  pictorial  research. 

Much  of  ifce  recent  literature  concerning  the  use  of 


X 

N 

S 


ERIC 


405 


Page  20 

illustrations  in  text  has  stressed  the  need  for  an 
assessment  of  the  instructional  function  being  served  by  the 
illustration,    when  an  illustration  is  incorporated  into 
textual  matter,  it  should  be  serving  a  specific, 

m 

pedagogically  sound  instructional  function.    Otherwise,  the 
reader  will  probably  not  benefit  from  the  illustration's 
inclusion  in  the  text;  in  fact,  the  reader  might  be 
distracted  from  the  text  by  the  illustration,  with  no 
cognitive  gain  being  derived  from  this  distraction. 
Therefore,  to  the  traditional  criteria  for  selection  of 
illustrations  used  with  text  must  be  added  perhaps  the  most 
important  criterion,  instructional  function  intended  to  be 
served. 

To  determine  whether  an  illustration  will  effectively 
serve  an  intended  instructional  function,  a  close 
examination  of  both  the  illustration's  attributes  and  its 
relationship  to  the  text  must  be  made.    Research  has  shown 
that  illustrations  are  composed  of  a  variety  of  attributes, 
pertaining  to  physical,  instructional  and  relational 
qualities  of  the  illustrations,  and  that  these  attributes 
affect  the  way  in  which  illustrations  can  be  used  as 
instructional  tools.    Therefore,  the  attributes  present  in 
an  illustration  will  account  in  part  for  its  effectiveness 
in  serving  an  instructional  function. 

In  light  of  this,  a  study  was  developed  to  demonstrate 
the  relative  effectiveness  of  two  illustrations,  which 
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Posses,  differences  concerning  the  type  ,f  * 
format  they  provide  i  repre.entational 
ney  provide  in  supplementing  text    «„  - 

««i»ct  instructional  .functions     '        '  *  '""^  >~ 

the  overall  o  °£  "hicn  a8sl«  »" 

over.!!  comprehension  of  a  textual  p..8aoe  .„ 

hypotheses  of  the  studv  ™  PtlBary 

ne  study  were  that  illus<-r.<.<. 

-o*cal  repression  hetter  ser      t  !  P'°Vldln' 

—ion  of  ^.n,  clarlfying  >b zz r,onai 

i«*««tio„.  and  that  .„    ,  tr"Ct  °r  n0nPh*no"»"«li 

that  illustrations  providing  literal 
representation  better  serve  the  f  . 
u    ,  6  function  of  identifvln- 

Physical  properties  of  ,h«  «entifyi„g 

ties  of  phenomenal  information. 
The  hypotheses  were,  tested  by  assio„lno  m 
college  level  *„,,.    ,  "signing  the  reading  of 

9         61  te"tUal  ««rpts  to  two  groups  of  coll 
students.    Tha  „,«  **°ups  of  college 

-  .n».  rati!  ^  ^  P88M9e8'  ~  ■"■»»«". 

,onP  P,°V-dln9  anal09lCal  of 

"onphenomenal  information  discussed  i„ 

other  utin  ,  he  pas"9«'  the 

utilising  .„  i„ustratlon 

"Presentation  of  phenomenal  information  d< 

passage     wh,i  rormation  discussed  in  tne 

P       9«.    While  group  one  read  ,  pa88age  ,« 

illustration  depicting  an  analogical  xeor 

two  read  th«  "Presentation,  group 

depic  PaS889e  UtU1Zin9  "  '"""""on 

oPicting  a  literal  representation.    This  procedure  _ 

reversed  for  the  second  passage.    Thus  both 

Passages    e~h  „  h  9r0ups  tead  two 

'            '       h  ^  UtiUlln'  -  'lustration  „lth  . 

different  depiction.    Results  .  w 

test,  were       ,  »»bse,ue„t  comprehension 
rests  were  analyzed  to  determine 

oetermine  the  relative  effects  »#  „. 

illustrations  on  comprehension- of  nh 

.        slon  or  phenomenal  and 
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nonphenomenal  information  within  the  passage. 

The  analyses  of  variance  that  were  performed  support 
the  stated  hypotheses  of  the  study.    Specifically,  an 
illustration  which  provides  a  literal  representation  of 
information  introduced  in  c*he  passage  was  shown  to  be  more 
effective  in  serving  the  instructional  function  of 
identifying  physical  properties  of  phenomenal  information 
introduced  in-  the  text.    Conversely,  an  illustration  which 
provides  an  analogical  representation  of  information 
introduced  in  the  passage  was  shown  to  be  more  effective  in 
serving  the  instructional  function  of  clarifying 
nonphenomenal  information  in  the  text.  These  findings 
suggest  that,  in  instructional  situations  similar  to  the  one 
in  this  study,  illustrations  possessing  literal 
representation  are  more  effective  than  illustrations 
possessing  analogical  representation  when  the  instructional 
function  to  be  served  is  identification  of  properties  of 
phenomenal  information,  and  illustrations  possessing 
analogical  representation  are  more  effective  than 
illustrations  possessing  literal  representation  when  the 
instructional  function  to  be  served  is  clarification  cf 

i 

nonphenomenal  information. 

Thus,  this  study  is  one  of  many  needed  to  provide  a 
comprehensive  analysis  of  illustrations  functioning  as 
instructional  supplements  to  text.    Until  a  thorough 
understanding  of  the  relationship. between  attributes  and 
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functions  of  illustrations  is  achieved,  textbooks  will  in, 
all  probability  continue  to  include  illustrations  which  do 
not  fulfill  their  instructional  potentials 
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Using  Case  Study  Methodolo$y 
To  Describe  Development  Communication  Programs 


In  the  discipline  of  development  communication,  case  study 
methodology  has  been  widely  used  to  describe  and  investigate 
activities  of  communication  programs 

Proven  systematic  methods  of  description  and  analysis  are 
not  universally  available  for  the  case  study  methodology  in 
development  communication  situations.  It  falls  to  the  researcher 
interested  in  developing  a  case*  to  piece  together  and  build  a 
framework  for  the  description  of  a  particular  problem. 

There  are  at  least  two  major  ways  to  organize  case  study 
data  (Schatzman  and  Strauss*  1973).  The  first  is  straight  de- 
scription; it  uses  the  theoretical  and  organizational  schema  of 
the  discipline  itself.  The  researcher  simply  employs  a  classifi- 
catory  system  and  describes  the  case  by  that  particular  model. 
With  analytic  description,  the  classif icatory  system  is  developed 
from  the  data.  Thus,  new  organizational  and  theoretical  models 
can  be  developed. 

Walton  (1972)  provides  a  brief  checklist  of  what  a  general 
case  study  must  describe.     This  includes 

...longitudinal  data  from  each  of  several  phases- 
pre-lntervention,  intervention,  and  post- intervention; 

...rigorous  description  of  process  especially  during 
the  intervention  phase; 

...conceptualization  and  theorization  about  the 
process  itself,  e.g.  interactions,  phases,  critical 
incidents,  and  their  effect  on  subsequent  attitudes 
and  actions,     (p.  76) 


In  this  paper  twelve  development  communication  case  studies 
will    be  examined  to  uncover  their  organizational    schema;  these 
findings    will    be  poolud  to  form  a  suggested  framework    for     the  ^ 
design  of  future  case  studies  in  devexopmerit  communication. 


Background 

Definition    of  a  Case  Study,     flouley ( 1 970)  writes  that 
a  case  study  is 


"...designed  to  identify  the  antecedents 
responsible  in  a  direct  or  indirect  'causa- 
tive1 way  to  the  occurence  of... the  present 
case...1^  (p.  347) 
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Man  Dalen  (1973)  echoes  Plouley  when  he  writes  that  a  case  study 
is  "an  intensive  investigation  of  a  social  unit11  (p.  207)  in 
which  the  researcher  gathers  data  about  the  topic  of  the  study, 
examines  the  relationships*  and  then  develops  the  description. 

While  not  defining  case  study  methodology*  Kerlinger  (1973) 
does  describe  ex  post  facto    research  as 

"systematic  empirical  inquiry  in  which 
the  scientist  does  not  have  any  direct  con- 
trol of  independent  variables  because  their 
manifestations  have  already  occurred  or-  be- 
cause they  are  inherently  not  manipulable. 
Inferences  about  relations  among  variables 
are  made*  with  direct  intervention,  from 
concomitant  variation  of  independent  and 
dependent  variables."  (p,.379) 

Case  study  methodology  is  one  type  of  ex  post  facto  study. 

In  a  paper  analyzing  the  use  of  qualitative  case  studies  in 
the  social  sciences,  Wilson  (1979)  lists  four  factors  common  to 
case  studies.  First,  case  studies  are  particularistic ;  they  des- 
cribe real  activities  of  a  specific  situation.  Next,  Wilson  says 
that  case  studies  ere_  holistic?  they  describe  a  wide  variety  of 
variables  and  discuss  their  interrelationships.  Case  studies  are 
longitudinal;  they  describe  events  over  time.  Finally,  Wilson 
notes  that  case  studies  are  qualitative;  prose,  quotes,  and 
sample  materials  may  be  used  to  document  the  case.  Based  on 
these  four  generic  qualities,  Wilson  goes  on  to  define  a  case 
study  as 

"...a  process  of  research  which  tries  to  describe 
and  analyze  some  entity  in  qualitative,  complex, 
and  comprehensive  terms... as  it  unfolds  over,  a 
period  of  time."      (p. 448) 

I he  case  study,  then,  has  two  recognizable  parts;  the  first 
scriptive  uhile  the  second  is  snalytical  and  diagnostic 
^Lombard,  1978;  Schatzman  and  Strauss,  1973).  This  paper  will  use 
Wilson's  definition  as  a  guide  in  the  development  of  the  case 
study  methodology  to  describe  development  communication  programs. 
It  will  focus  on  the  descriptive  element  of  the  case  study. 

Rationale  for  a  Case  Study.  Before  a  researcher  can  fully 
utilize  .  a  particular  methodology,  "a  rationale  must  be  provided. 
In  development  communication  programs  a  case  study  methodology  is 
often  used  for  three  reasons. 

First,  a  case  study  provides  information  on  applications  of 
theoretical  concerns  in  the  real  world  (Lombard,  1978;  Wal  an, 
1972).  As  such,  Uilman  and  Krasner  (1966)  noted  that  case  studies 
"illustrate    procedures  end  provide    a  source  of  ideas  as  to  how 
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problems  may  be  approached."  (p.  45).  There  is  a  trend  among 
social  scientists  to  describe  activities  in  their  natural  setting 
(Wilson*  1977).  This  is  because  of  the.  significant  Influence  of 
the  environment  on  human  events  and  the  divergence  of  results 
from  laboratory  studies  of  similar  phenomenon  (Barker,  1968; 
Willems  end  Reush,  1969).  .  Kerlinger  (1971)  notes  the  realism  of 
the  field  study  and  implies  that  it  exists  in  the  case  study  when 
he  writes  that  there  "can  be  no  complaint  of  artificiality..." 
(p.  407). 

A  case  study  also  provides  a  large  range  of  detail  (Riley, 
1963).  Rather  than  focusing  on  one  particular  area  and  selecting 
e  limited  number  of  aspects  for  examination,  a  researcher 
developing  e  cese  study  gsthers  and  describes  a  wide  array  of 
data.  This  data  allows  a  researcher  to  illustrate  theoretical 
concerns  and  to  provide  examples. 

The  second  reeson  for  espousing  a  case  study  methodology  to 
describe  development  communication  programs  is  that  such  a  study 
uncovers  relstionships  (Katz,  1953).  Both  Kerlinger  (1973)  end 
ftouley  (1970)  respectively  argue  that  field  studies  and  case 
studies  are  useful  in  describing  and  analyzing  relationships. 
These  relationships  are  what  Riley  (1963)  calls  "latent  patterns" 
(p.  69),  relations  that  the  object  under  study  may  not  be  aware 
of  completely. 

Walton  (1972)  suggests  that  a  cas~e  study  methodology 
uncovers  relationships  when  it 

allows  '   the      reader    to    identify    with  persons 
or  place  himself  in  role  positions  in  the  situation;  . 

captures  the  affective  mood  and  other  dynamic 
properties  of  the  unfolding  situation; 

separates  the  description  from  the  concep- 
tualization and  generalization.     (p.  77) 

Thus  the  process  element  of  a  case  study,  the  describing  of 
relationships,  is  a  second  reason  for  using  a  case  study  in 
reporting  a  development  communication  program. 

finally,  case  study  methodology  has  a  heuristic  quality.  As 
the  case  is  described  and  the  variables  examined,  a  variety  of 
hypotheses  tend  to  emerge.  This  heuristic  quality  links  imple- 
mentation to  theory  and  provides  meaning  for  concepts  and  docu- 
ments them  in  new  ways  (Bennis,  1978;  Ullman  and  Krasner,  1966). 
Case  study  methodology,  Wouley  (1970)  argues,  "probably  makes  its 
greatest  contribution  to  the  advancement  of  science  as  a  source 
of  hypotheses  to  be  verified  by  more  rigorous  investigation"  (p. 
348). 
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In  summary ,     there  are  three  main  reasons  underlying  the  use 
of  the  case  study  in  the  area  of  development  communication: 

1 .  to  illustrate  and  provide  examples, 

2.  to  uncover  relationships,  and 

3.  to  develop  suggestions  for  future  action. 


Limitations  of  the  Methodology*  <-  As  with  any  research  me- 
thodology* the  case  study  has  certain  limitations.  The  most, 
important  limitations  are  the  number  of  variables  encountered, 
the  precision  in  description*  the  tendency  to  over-emphasize 
unusual  events*  and  the  generalizability  of  the  findings. 

The  first  restriction  stems  from  the  multiplicity  of  variab- 
les encountered  (*er linger,  1973).  Since  it  is  a  descriptive 
type  of  resserch  ,  a  case  study  tends  to  produce  a  plethora  of 
information.  Sorting  and  categorizing  the  information  become 
extremely  difficult.  * 

Because  of'the  complex  nature  of  real  events,  the  quantity 
of  information  generated,  and  the  absence  of  experimental  control 
devices,  a  esse  study  may  be  unsystematic  in  its  description 
(Campbell  and  Stanley,  1963).  Contrasted  with  experimental  and 
quasi-experimental  designs,  the  lack  of  precision  is  a  limiting 
factor. 

Case  study  methodology  has  a  "tendency  to  overemphasize 
unusual  events  or  to  distort  them  for  dramatic  effect..."  (Van 
Oalen,  1973).  Given  the  previously  mentioned  limitations,  the 
researcher  can  develop  a  particular  mind-set  which  "...may  blind 
him  to  certain  significant  aspects  of  the  situation1*  (fflouley, 
1970,  p.  349).  This  biased-viewpoint  effect  (Riley,  1963)  might 
cause  the  selective  recording  and  skewed  analysis  of  the  avail- 
able information. 

Possibly  the  greatest  limitation  encountered  by  the  case 
study  is  the  inability  to  generalize  its  findings.  This  stems 
from  two  separate  problems:  the  collection  and  interpretation  of 
dependable  data  and  the  case  study  methodology  itself.  fflouley 
(1970 )  comments  on  the  readily  available  data: 

...when  these  data  were  collected,  present  needs 
were  not  anticipated,  and  as  a  result,  the  data 
were  probably  not  collected  and  recorded  system- 
atically enough  to  be  dependeble  and  understandable 
in  the  context  of  the  present  problems  (p.  351). 

Plouley  then  notes  that  "obtaining  dependable  data  from  which 
valid  interpretations  can  be  derived"  (p.  348)  is  a  major 
problem  in  using  a  case  study  method. 
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Analyzing  and  interpreting  the  data  also  cause  problems. 
Because  the  quantity  of  information  generated  (Riley*  1963)  and 
the  lack  of  established  guidelines  (Kennedy ,  1979) ,  the  synthesis 
"...must  rely  heavily  on  the  investigator's  judgment ,  if  not 
intuition,  as  to.. .(the  information* s J  relevance  and  significan- 
ce* (ftouley,  1970). 

Both  the  methods  of  collection  and  interpretation  of  data 
limit  the  case  study  in  its  ability  to  yield  generalizations.  No 
direct  control  of  the  independent  variables  takes  place  in  a  case 
study;  further  randomization  is  lacking,  methodologically  speak- 
ing ,  control  and  randomization  alloy  for  a  wider  applicability  of 
research  findings.  Thus  the  methodology  of  the  case  study  dif- 
fers from  experimental  research  (Campbell  and  Stanley,  1963: 
Kerlinger,  T973|  Kennedy,  1979). 

These  limitations  to  the  case  study  method  may  be  lessoned 
by  developing*  a  rigorous  framework  in  which  development  communi- 
cation programs  can  be  described. 

Method 

Development  communication  case  studies  were  selected  based  on 
their  a)  availability  in  the  general  literature,  and  b)  ability 
to  meet  Wilson's  (1979)  criteria  of  a  good  case  study — 
particularistic,  holistic,  longitudinal,  and  qualitative.  Twelve 
case  studies  of  development  communication  projects  were  then 
examined  to  determine  what  descriptive  categories  were  held  'in 
common  across  cases  and  what  new  categories  emerged.  As  each 
case  was  reviewed,  the  descriptive  categories  developed  by  the 
particular  author  or  which  were  self-evident  were  listed.  This 
listing  was  then  put  on  a  matrix  ,  shown  in  Table  1. 


Insert  Table  1  About  Here 


Results 

The  matrix  presented  in  Table  1  indicates  that  the  catego- 
ries below  were  mentioned  in  eleven  or  more  case  studies.  They 
are  listed  in  random  order. 


1 .  Channels 

2.  Results 

3.  Project  Design 

4.  Objectives 

5.  Audience 

6.  Background 


7.  Overview 

8.  Scope 

9.  Location 

10.  Time/duration 

1 1 .  Message 

12.  Sector 


Other  categories  mentioned  in  more  than  half  the  case  studies 
include: 
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1 .  Organisation/administration 

2.  Sponsorship 

3.  Evaluation 


Nine  categories  were  mentioned  in  less  than  half  the  case  studies 
surveyed. 


Olscussion 


All  the  models  outlined  above  mere  designed  to  describe 
specific  projects.  Herein  lies  both  the  strengths  and  weaknesses 
of  each. 

Since  every  model  was  developed  for  a  particular  project * 
its  author(s)  and  developer(s)  felt  it  to  be  the  most  appropri- 
ate. For  other  researchers*  however *  each  model  lacks  something 
they  believe  should  be  included.  An  examination  of  the  models 
indicates  that  there  is  general  agreeement  on  the  majority  of 
steps    which  must  be  included.    Most  of  these  steps  fall    into  a 

?eneral    theoretical    description    of  the    communication  process 
source*    message,    channel*     receiver,  and  f eedbackf Berlo, 1 960 ] ; 
who  says  what  to  whom  with  what  ef f ect [Lasswell*  1948]).  / 


Differences  among  models  stem  largely  from  their  point  of 
origin  rather  than  from  radically  divergent  methods  of  case 
description.  For  example*  the  Diaz-Cisneros  model  (I977)was  used 
to  describe  a  relatively  large  scale  agricultural  development 
project;  the  Unesco  model  (1976)  was  used  to  study  literacy  pro- 
jects; the  Planandhar*  et  al.  (1982)  model  was  used  to  examine  a 
forestry  program.  All  the  authors  are  united  by  a  strong  commit- 
ment to  a  complete  case  study  description.  However,  since  there 
is  no  standard  description  each  author  must  originate  a  new  model 
for  a  new  case. 

To  overcome  some  of  the  limitations  of  the  case  study  meth- 
odology* a  generalizrble  framework  for  the  descriptive  phase  of 
development  communication  case  studies  is  suggested.  Of  course* 
generalization  of  findings  depends  on  the  concepts  of  validity 
and  reliability.  If  a  development  communication  case  study  has 
depicted  what  it  purports  to  assess*  the  study  can  be  said  to  be 
valid.  And  if  independent  observations  of  the  situation  uouW 
produce  similar  data*  the  study  can  be  said  to  be  reliable. 

The  proposed  framwork  offers  a  structure  to  more  systemati- 
cally describe  development  communication  program  in 'such  a  way 
that  the  case  study  could  be  replicated. 


1 . 
2. 
3. 
4. 
5. 


Cost  6.  Research 

Dissemination  7.  Funding 

Staff  8.  Sources  of  information 

Timelines         9.  References 

Communication 
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On  the  basis  of  this  review*  a  case  study  model  is  now 
proposed  which  takes  into  account  all  the  categories  noted  in  the 
previous  models.  The  proposed  framework  for  developing  a  devel- 
opment communication  case  study  is  presented  in  Table  2. 


Insert  Table  2  About  Here 


Four    categories    have  been  added  to  the  list  which  was  de- 
rived   from  the  analysis  of  the  case  study    models.      These  four 
categories    come  from  the  literature  of  development  communication 
(Bordenaue, 1977;      Bur susphat, 1981  f      fflaglalang,      1976;  Moods, 
.1982,1983). 

a.  Name  (i)--this  is  the  development  com- 
munication project  name  and  acronym. 

b.  Pretesting  ( 2 ) --this  is  a  component  of 
most  models  of  media  and  message  development 
While  pretesting  is  not  often  reported, 

its  inclusion  in  a  case  study  might  help 
other  project  developers  learn  processes 
and  approsches  to  improving  communication. 

c.  Formative  evaluation  (20) — this  also  is 
a  part  of  most  models  of  communication.  If 
formative  evaluation  is  done,  the  results 
should  be  reported. 

d.  Monitoring  (21 )--this  is  the  implementa- 
tion of  the  formative  evaluation,  which  should 
detail  what  changes  were  made  in  the  program 
as  a  result  of  its  actual  implementation 

in  the  field. 

A  minor  limitation  of  this  current  work  is  that  an  N  of  12 
is  somewhat  small  on  which  to  generalize.  While  this  may  be  true 
in  an  extreme  experimental  model,  for  the  work  in  developing  a 
case  study  frantework,  which  is  a  heuristic  device,  the  N  of  12 
seems  large  enough  to  be  both  reliable  and  valid,  at  this  point. 
In  a  totally  independent  study  which  hes  recently  surfaced, 
Harun,  et  jsl  (1978),  developed  an  outline  for  the  case  study  of 
communication  and  information  systems  in  developing  countries 
(Appendix  A).  The  case  study  categories  chosen  by  these  authors 
parallel  the  framewdrk  under  discussion  here,  and  In  fact  move 
case  study  methodology  into  a  more  analytical  mode. 


Summary 

A  28  category  framework  for  using  the  case  study  methodology 
to  describe  e  development  communication  program  has  been  present- 
ed. Work  remaining  to  be  done  to  further  improve  the  case  study 
methodology  includes: 
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1 .  development  of  models  and  techniques 
for  analyzing  a  single  case  study,  and 


2.  development  of  techniques  for  aggregating 
case  study  date  and  then  analyzing  it. 


The  purpose* of  this  model  is  to  provide  a  systematic  frame- 
work for  describing  a  development  communication  case  study.  This 
framework  does  not  intend  to  be  a  tool  of  analysis;  it  is*  ra- 
ther, descriptive.  Analysis  tools  woui^f  have  to  be  further 
developed. 
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Table  2t  Proposed  Cose  Study  Framework  for 
Describing  Development  Communication  Programs 


'sograms 

1  ' 


Category 

Description 

1  a  Name 
2.  Sector 


3.  Time/duration 


4.  Location 


5.  Scale/scope 


6.  Sponsorship 


7.  Funding 


8.  Background 


9.  Administration 


10.  Objectives 


1 .  The  name  and  acronym  of  the 
development  communication  program 

2.  The  discipline  in  which  the 
development  communication  program- 
was  undertaken,  iy*e)*»  agricultural 
development ,  health  education , 
forestry  >Vr-*~ 

3.  The  project's  period  of  oper- 
ation, i.e.,  the  beginning  and 
ending  times 

• 

4.  The  description  of  the  location 
in  which  the  project  is  implemented, 
i.e.,  country,  regions 


5".  A  description  of  the  size  of 
the  project,  i.e., national,  ■/ 
regional,  village,  pilot,  etc. 


\ 


6.  A  description  of  the  organiza- 
tions responsible  for  the  sponsor- 
ship and  implementation  of  the 
project 

7.  A  listing  of  thS  monies  put 
into  the  development  communica- 
tion project,  allocated  by  year 
and  category  if  possible 

8.  A  description  of  the„origins\ 
history  of  the  problem,  genesis 
of  the  organizational  involvement 
and  reason,  and  other  relevant 
background  factors 

s 

9.  A  description  of  how  the 
development  communication  project 
is  administratively  lodged  iiito  a 
larger  organization,  including 
resources  and  division  of  labor 

10.  A  listing  of  the  stated  objec- 
tive^ or  goals  of  the  project'  and 
of  tyfe  larger  program  v 
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11.  Audience 


12.  Staff 


13.  Project  Design 


m 

14.  Communication  style, 


IS.  Messages 


16.  Channels 

« 

17.  materials 

t 

/«d8.  Pretesting 
19.  Dissemination 


20.  formative  evaluation 


11.  A  description  of  the  target 
audlence(s)  of' the  development 
'communication  project 

12.  A  description  of  the 
relevent  data  and  backgrounds  - 
of  the  major  project  staff  and 
their  roles 

13.  A  description  of  how  the 
development  communication  pro- 
ject fitae  organized  to  meets  its 
objectives  and  a  description 

of  the  planned  activities  for 
the  project's  development 

14.  A  description  of  the  commu- 
nication strategies  in  terms 

of  messsge  design  approaches 
and  channel  selection  approaches i 
a  description  of  the  wsy  the 
message  and  medium  ere  programmed 
£o  achieve  the  project  goals  » 

15.  A  description  of  the  messages 
designed  by  the  project  for  the 
target  audience 

16.  A  description  of  the  'specific 
media  employed  in  the  communication 
effort  % 

17.  A  description  qf  the  materials 
which  were  developed *  i.e,  flip 
cherts  which  show  planting  calenders, 

18.  A  description  of  pretest  stra- 
tegies and  results 

19.  A  description  of  the^dif fusion 
and  utilization  strategies 9'  i.e., 
messages  end/ or  *  materials  actually 
reaching  the  target  audlence(s) 
(media  schedules ,  extension  agent 
utilizetion) 

20.  A  description  of  any  formative 
evaluation  activities  that  took  place 
in  the  development  communication 
project. 


>  «4 


21 •  Monitoring 


22.  Results 


23.  Costs 

24.  evaluation 

25.  Timelines 

26.  Research 


27.  Sources  of 
Information 


2d.  References 


21 •  A  description  of  how  any  in- 
process  changes  derived  from  pre- 
testing *  formative  evaluation,  or 
outside  reviews  ware  implemented 

« 

22.  A  description  of  the  planned 
and  unplanned  outcomes  of**  the  de- 
velopment communication  project; 
descriptions  of  knowledge  gains* 
practices*  etc. 

23.  A  description  of  the  financial 
costs  of  the  project,  i.e.,  cost/ 
audience  contacted*  cost  of  buying 
broadcast  time 

24*  A  description  of  the  results  of 
any  evaluations  that  were  done 

25.  -  A  description  of  the  month  to 
month  activities  of  the  development 
communication  project 

26.  A  description  of  the  results 
of  any  research  that  occurred  as 
part  of  the  project 

27.  A  listing  of  the  sources  of 
information  that  allowed  the  case 
study  to  be  written,  i.e.* project 
reports*  site  visitations* brochures* 
interviews 

28.  A  listing  of  any  published  or 
publically  accessable  references 
which  describe  the  case  study  in 
any  way 
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APPENDIX  A: 
OTCP  GUIDELINES  FOR  PREPARING  CASE  STUDY* 


1.  Name  of  organization 

2.  Basic  objectives  and  goals  of  the  organization 

m 

3.  Clientele  served 

4.  General  description  of  resources- -budget ,  staff*  areas 

covered*  physical  facilities,  etc. 

5.  Existing  internal  and  external  communication  policies  within 

the  organization  and  those    external  affecting  the 
organization 

6.  Inventory  of  current  communication  activities  for  the 

following  functions: 

< 

6.1  Serving  clientele 

6.2  Feedback  from  clientele  for  programme  planning 

6.3  Nanagement  monitoring,  control  and  coordination 

6.4  Technical  (research)  information  reporting, 

processing  and  utilization 

6.5  Formulating  overall  policies  and  goals 

6.6  Staff  development  and  relationships 

6.7  Gaining  popular  suppport  and  participation 

6.8  To  and  from  other  organizations 

7.  Inventory  of  communication  resources 

7.1     Physical  facilities-- i . e .  meeting  rooms, 

training  areas,  libraries,  data  banks,  etc. 

7.2'    Equipment--! .e.  telephones,  computers;  audio- 
visual, printing  machines,  mobile  units,  etc. 

7.3  Communication  training  given  to  staff 

7.4  Finances  allocated  to  communication  activities 

8.  Communication  problems  observed: 

8.1  Relevance  of  message  content 

8.2  Timing 

8.3  Reaching  the  incorrect  persons 

8.4  Misunderstanding  messages  by  receivers 

8.5  Accuracy  of  information 

8.6  Responsiveness  to  feedback 

8.7  Volume  of  information  (overload  or  insufficient) 

8.8  Appropriateness  of  communication  channel/techniquie/ 

media  selected 


*  Harun,  R.,  et  al.,  1978.  pp.  7-8. 
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9.  Possible  causes  of  these  problems: 

9.1  Communication  capabilities  of  staff 

9.2  Organizational  structure 
9*3    Communication  policies 

9.4  Externel  pressures 

9.5  Poor  (or  leek)  of  communication  planning  and 

strategy  formuletion 

9.6  Availaility  of  finances  for  communication 

activities 

9.7  Physical  facilities 

9.8  Communication  equipment 

9.9  Sophisticetion  level  of  message  content 

9.10  Sophistication  level  of  channels/techniques/media  used 

9.11  Direction  of  information  flows 

9.12  Formal  and  informal  channels  misused 

9.13  Perception  differences  between  sender  and 

receiver  of  message 
9.16  Commitment  to  communication  activities  by  top 

administrators 
9.15  Language  or  dialect  used 

10.  Recommend  solutions  or  course  of  action  for  overcoming 


the  problems 


11.  Executive  summary  of  findings  and  recommendations 
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Video  as  a  Means  for  Analyzing  Teaching: 
Towards  a  Process  of  Self-Reflection  and  Critique 

The  Interactive  process  of  teaching/ learning  1s  a  complex  expertence. 
Recent  trends  1n  studying  teaching  examine  teaching  behavior  and  Its  effects 
on  student  learning.   Systems  of  codification  of  various  teaching  activities 
have  been  developed,  and  the  analysis  of  teaching/ learning  continues  and  along 
with  1t  the  "need"  for  refining  the  process  Into  more  discreet  activities 
linked  with  specific  Intended  outcomes.   This  presupposes  that  teaching/ 
learning  can  be  reduced  to  measureable  activities,  corrected  or  reinforced 
upon^ proper  Identification.    The  more  refined  this  process  becomes,  the  more 
"scientific"  the  analysis. 

In  this  paper  I  will  argue  that  during  the  past  two  decades,  research  on 

teaching  effectiveness  can  be  Identified  within  three  differing  paradigms: 

» 

1)  the  technical /ttsc1ent1 fie";  2)  the  humanistic;  and  3)  the  person- centered 
paradigms.    I  will  further  argue  that  If  we  view  teaching  as  an  art  or  craft, 
and  learning  as  an  ever  present  process,  rather  than  an  "event,"  the  real 
complexity  of  the  teaching/learning  experience  can  be  clarified.   To  do  this 
in  a  way  different  than  the  Identification  of  discreet  behaviors/outcomes,  we 
will  need  to  redefine  the  problems  for  analysis.  • 

I  will  provide  a  theory-base,  or  rationale  for  extensive  use  of  video  1n 
the  analysis  of  teaching.   My  intention  will  be  to  clarify  the  theory-practice 
dilemma.    I  will  suggest  going  beyond  the  use  of  mlcroteachlng  as  a  form  of 
analysis  of  discreet  teaching  activities.    I  will  suggest  going  beyond  an 
analysis  of  teaching  through  a  process  of  self- reflection  (reflective- teaching 
model-cf.  Cruickshank,  N.O.).    I  will  propose  a  model  for  the  analysis  of 
teaching  through  a  process  of  self- reflection  and  critique,  based  on  the 
problem- posing,  dialogic  model  of  Paulo  Frelre  (1970;  197JL).*— IMs  will   
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require  an  extensive  use  of  video  with  actual  teaching/learning  situations, \ 

\ 

and  developing  a  framework  for  analyzing  the  teaching/learning  process.  \ 

TEACHING  EFFECTIVENESS  RESEARCH 
During  the  past  two  decades  three  distinctly  different  approaches  to  the 
study  of  teaching  effectiveness  have  been  established.   The  research  currently 
dominating  the  field  reflects  a  technical  rationality.   Research  efforts 

» 

receiving  token  attention  cluster  around  what  is  commonly  referred  to  as 
bumanlstte  teaching^  An  almost  totally  Ignored  area  of  research  can  be 
appropriately  labeled  person- centered  teaching.   The  assertion  that  research 
related  t<\tj*e  study  of  teaching  effectiveness  can  be  classified  as  either 
dominant,  token,  or  Ignored  1s  dramatized  when  one  examines  the  Encyclopedia 
of  Educational  Research  (1982)  and  finds  only  one  (Combs,  1962)  humanistic 
reference  listed  under  the  sections  titled  Teaching  Characteristics  (Ryan  & 
Phillips.  1982),  and  Teaching  Effectiveness  (Medley,  1982),   The  references 
listed  for  these  two  sections  are  studies  reflecting  a  technical  model  while 
per son- centered  teaching  effectiveness  research  1s  not  reported. 
Additionally,  the  reader  will  immediately  recognize  that  most  major 
educational  journals  devoted  to  reporting  teaching  effectiveness  research  have 
followed  a  similar  posture  over  the  past  decade. 

THREE  RESEARCH  APPROACHES* 
Dominant  Research:  Technical 

The  majority  of  research  on  teaching  effectiveness  has  focused  on  studies 
concerned  with  Instructional  methodologies  and  pupil  achievement  (Anderson, 
Evertson  &  Brophy,  1979;  Fisher,  Harlave  &  F1lby,  1979;  Good,  Blddle  &  Brophy, 
1975;  Russell  &  Fea,  1963),  teacher  characteristics  and  teaching  effectiveness 
(Brophy,  1979;  Coker,  Medley  &  Soar,  1980;  Getzels  &  Jackson,  1963;  Raskow, 
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Alrasian'S  Madaus,  1978).  and  teacher  behaviors  as  related  to  pupil 
achievement  (Good,  1979;  Joyce  &  Mali ,  1980;  Rosenshlne,  1976;  Withal  1  ft 
Lewis,  1963). 

Studies  of  teaching  of  this  nature  have  followed  a  technical- political 
model  based  on  a  scientific,  rational  explanation  of  human  behavior.  This 
approach  to  explaining  effective  teaching  performance  suggests  that  the  proper 
blending  of  techniques  and  content  will  significantly  Increase  student 
performance.   This  pos1t1v1st1c  attitude  views  teaching  as  a  science/ 
technology  with  Identifiable,  observable  skills  that  are  considered  to  be  the 
"practice"  of  teaching.   While  I  am  willing  to  admit  there  are  certain  techlng 
skills  that  can  be  taught  and  measured,  I  reject  the  notion  that  teaching  is 
fundamentally  comprised  of  the  proper  blend  of  techniques,  methods,  and 
skills. 

The  technical- rational  model  applied  to  teaching  effectiveness  suggests 
precise  reasoning  ("scientific  accuracy")  and  predictability,  and  the  nature 
of  this  model  has  an  interest  1n  control  through  management  procedures.  As 
the  teaching  profession  has  become  an  increslngly  highly  skilled  technology 
with  a  primary  emphasis  on .methods  and  outcomes,  teachers  have  been  rewarded 
for  guiding  their  practice  in  ways  that  are  amenable  to  this  technology.  As 
MacDonald  suggests  (1975),  this  notion  Implies  that  "teachers  are  potentially 
interchangeable,"  and  leads  to  viewing  productive  activity  as  something 
learned  and  performed  "mechanistically. "    Thus,  any  "good"  teaching  activity 
can  be  produced  by  any  other  teacher^ and  "all  productive  teaching  1s 
measureable  1n  terms  of  the  criteria  of  the  accountability  In  use 
(pp.  79-80)." 

Apple  (1982)  refers  to  this  as  a  process  of  "deskllHng- reselling"  the 
teacher: 
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As  the  procedures  of  technical  costrol  enter  Into  the  school  In  the 
guise  of  pre- designed  curr1cular/teach1ng/ev*luation  'systems', 
teachers  are  being  deskllled.   Yet  they  are  also  being  reskllled  1n 
a  May  that  1s  quite  consequential.   .  .  .  while  the  deskHUng  In- 
volves the  loss  of  craft,  the  ongoing  atrophlcatlon  of  educational 
skills,  the  reskllHng  involves  substitution  of  the  skills  with 
Ideological  visions  of  management  (p.  256). 

Tom  (1977)  contends  that  what  1s  lacking  1n  the  managerial  perspective  1s 
acknowledging  Interpersonal,  or  social  relationships: 

i 

.  .  .  these  relationships  cannot  be  reduced  to  a  collection  of 
techniques  without  debasing  them  and  stripping  them  of  their 
humanity.   However,  even  1f  one  rejects  this  humanistic  concern, 
there  1s  another  fundamental  problem.   A  technology  must  have 
definite  ends  toward  which  Its  activity  1s  aimed.   There  1s, 
of  course,  no  long- terra  consensus  on  the  alms  of  education 
(p.  38). 

/ 

The  lack  of  consensus  on  the  alms  of  education  within  the  technical  model 
is  not  viewed  as  problematic  because  there  are  commonsense  understandings  of 
purpose  within  the  model.    The  position  here  becomes  one  of  value-neutral  1ty, 
i.e.  teaching  and  learning  as  apolitical. 
Token  Research:  Humanistic 

Running  concurrently  with  the  evolution  of  technical  rationality  as  a 
base  for  studying  teaching  effectiveness  have  been  research  efforts  reflecting 
a  humanistic  model.    This  movement  1s  receiving  little  more  than  token  atten- 
tion (Peter,  1977;  West,  1972).   Research  studies  sensitive  to  the  human 
aspects  of  the  teaching- learning  experience  have  Included  teacher  expectancy 
studies  (Davidson  &  Lang,  1960;  Rosenthal  &  Jacobson,  1969).    The  process  of 
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perceiving  which  precedes  expectations  1s  unique  tp  each  Individual.  Bruner 
(1958)  contends  that  humans  tend  to  maintain  1n  consonance  of  their  opinions* 
Ideas  and  attitudes.    Individuals,  therefore  attempt  to  minimize  surprise  by 
Imposing  a  subjective  consistency  upon  their  environments 

The  psychological  credibility  of  the  self- fulfilling  phenomenon  1s 

# 

perhaps  one  reason  that  research  has  continued  despite  the  failure  of 
Rosenthal  and  Jacobsen  to  provide  totally  convincing  evidence  (Braun,  1973). 
Neither  Snow  (1969)  nor  Thomdlke  (1968)  deny  the  fact  that  tec  her  expectation 
.may  be  a  powerful  force.   Additional  Impetus  has  been  provided  by  studies 
lending  support  to  that  phenomenon  (Brophy  &  Good,  1970;  Mendoza ,  Good  & 
Brophy,  1971). 

Interpersonal  relationship  studies  and  writings  by  Aspy  and  Roebuck 
(1980,  1982)  Combs  {1969)  Dleken  and  Fox  (1973)  and  Peterson  (1979)  can  also 
be  classified  as  humanistic  literature  currently  receiving  only  token 
attention.   After  a  review  of  the  literature,  Hamachek  (1969)  states  that 
effective  teeners  appear  to  be  those  who  are  human  1n  the  fullest  sense.  They 
have  a  sense  of  humor,  are  fair,  empathic,  more  democratic  than  autocratic  and 
are  able  to  relate  easily  and  naturally  to  students  on  a  one-to-one  and  group 
basis. 

Research  relative  to  learning  climate  (Anderson  &  Walberg,  1967;  Combs, 
1982;  Oobson,  Grey  &  Dobson,  -1979;  Sinclair,  1968)  seem  to  point  out  the  need 
for  caring,  understanding,  openness,  acceptance  and  genuineness.  Rogers 
(1983)  calls  .attention  to  the  significance  of  research  being  done  from  a 
humansitlc  perspective  when  he  states:  ; 

•  •  .this  research  provides  convincing  evidence-* from  two  teams 
based  on  two  continents-- showing  that  studetns  learn  more,  attend 
school  more  often ,  are  more  creative,  more  capable  of  problem  solv- 

Ml 


1ng»  when  the  teachers  provide  the  k4nd  of  human,  faclHtatlve  cli- 


mate that  has  been  described 


...  (p.  197^ 

Aspy  and  Roebuck  (1983)  further  support  Roger's  statement  when  they 
submit  that  their  findings  can  be  summarized  with  one  statement: 

.  .  •  students  learn  mire  and  behave  better  when  they  receive  high 

levels  of  understanding,  caring,  and  genuineness,  tran  when  they 

are  given  low  levels  of  them  (p.  199). 
Ignored  Research;   Person-Centered  ° 

While  these  two. distinctly  different  research  approaches  to  the  study  of 
teaching  effectiveness  have  been  occurring,  a  third  and  almost  totally  Ignored 
area  of  research  also  1s  being  conducted.   This  seemingly  Ignored  research 
effort  can  be  labeled  as  person- centered. 

Beginning  with  Dewey  (1910,  1964)  there  has  gradually  emerged  a  group  of 

* 

educators  who  have  come  to  view  a  teacher's  philosophy  as  the  basis  for  their 
decisions  about  the  educational  process.   Dewey  believed  that  humans  are  1n  a 
state  of  change  and  that  goodness  resides  1n  them.    The  significance  of 
Dewey's  thesis  is  amplified  by  Friere  (1981)  when  he  states,  "Our  pedagogy 
cannot  do  without  a  vision  of  man  and  the  world"  (p.  338). 

There  1s  ample  evidence  to  suggest  that  relatively  few  teachers  have 
developed  internally  consistent  philosophies,  I.e.,  techlng  behaviors  that  are 
in  accordance  with  their  professed  beliefs  (Brown,  1968;  Kesslnger,  1979; 
Wright,  1980).   Marshall  (1973)  contends  that  teachers  proceed  with  an 
eclectic  approach  comprised  of  bits  of  data  from  diverse  psychological  and 
philosophical  camps. 

Considering  this  state  of  the  art,  1t  seems  that  a  more  systematic 
treatment  of  teacher  beliefs- practice  congruency  relative  to  Instruction  wquld 
be  useful.   Wiles  and  8ond1  (1979)  suggest  th«t  educational  philosophies  are, 
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the  heart  of  purposeful  activity.   They  contend  that  because  teachers  are  - 
confronted  with  multiple  choices  for  schooling  the  young,  1t  1s  vital  that 
teachers  understand  their  own  values  and  beliefs  about  schooling. 
Morris  (1966)  states: 

A  limit  contingent  of  educators  *vho  have  come  to  see  the  phll- 
sophlcal  and  educational  problems  as  continuous  has  emerged.  Phil- 
osophy and  education  are  really  two  aspects  of  the  same  undertaking 
.  .  .  the  forming  of  those  fundamental  dispositions  toward  nature 
and  our  fellow  man  which  the  world  demands  of  us.    This  has  led  to  a 
going  beyond  educational  alms  and  strategies  to  examine  the 
relevance  of  a  person's  philosophical  thinking  1n  curriculum 
design,  teaching  methodology,  and  other  areas  such  as  administrative 
policy-making  (p.  76). 

Since  teachers  play  a  significant  part  1n  determining  the  educational 
environment,  1t  1s  Important  to  know  something  about  their  assumptions.?, 
relative  to  the  nature  of  humans.    Wrightsman  (1964)  contends  that  the 
assumptions  one  holds  about  what  people  are  really  Hke  influence  one's 
interactions  with  others.    Kelley  and  Rasey  (1952)  point  out  that  teachers' 
bas<c  beliefs  about  the  nature  of  humans  help  to  define  their  relationsnlps 
witVi  students.    Combs  (1962,  1982)  further  emphasizes  the  importance  of  a 
person's  basic  beliefs  about  the  nature  of  humankind  and  the  Influence  of  th1 
phenomenon  upon  numan  interaction  1n  the  educational  process. 

Social  scientists  have  come  to  realize  that  people's  assumptions  about 
the  nature  of  humanKind  can  be  conceptualized  and  measured,  and  1t  can  be 
determined  1f  these  beliefs  Influence  behavior  toward  others.  Wrightsman 
(1964*,  1974)  developed  an  instrument  for  measuring  people's  beliefs  about  the 
nature  of  humankind,  the  Philosophies  of  ftjman  Nature  Scale  (PHN).  Research 
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using  the  PHN  has  been  conducted  In  the  area  of  making  judgements  of  specific 
persons,  belief  differentiation  among  occupational  groups,  sex,  family  back- 
ground, religious  preferences,  authoritarianism  and  attitude  change,  child- 
ren's perception  of  the  educational  environment,  non-verbal  communication 
patterns,  verbal- nonverbal  congruency  1n  the  classroom,  moral  development,  and 
pupil  control  Ideology  (Childress  &  Oobson,  1979;  Deal,  Dobson  &  Dobson,  1982; 
Dobson,  Hopkins,  &  Elsora,  1973;  Dobson,  Sewell  &  Shelton,  1974;  Mason,  1966; 
Wrlghtsman,  1974).    These  studies  have  attempted  to  Identify  and  measure 
certain  basic  beliefs  about  the  nature  of  humankind  and  have  contributed 
normative  data  to  the  problem  of  Interpersoanl  aspects  of  humans.  Therefore, 
the  results  of  this  literature  emphasize  that  the  basic  beliefs  one  holds 
about  the  nature  of  humankind  comprise  a  viable  force  1n  the  structuring  of 
reciprocal  Interactions  among  people. 

Inherent  1n  a  teacher's  personal  philosophy  are  assumptions  about  the 
purposes  of  schooling,  the  nature  of  knowledge,  a  view  of  society,  and  the 
person* s"pos1t1on  within  that  society.    These  views,  have  an  effect  on  what  a 
techer  does  in  the  classroom.    How  teachers  organize  curriculum,  evaluate 
students,  \interact  with  students,  and  view  tnemselves  within  the  teaching- 
learning  context  are  all  affected  by  the  basic  philosophical  orientation  they 
bring  to  the,  classroom.    Zeichner's  (1979a,  1979b,  1980,  1981)  research  on  the 
student  teaching  experience,  teacher  socialization  and  reflective  teaching 
provides  a  rationale  and  direction  for  further  research  and  also  falls  within 
the  person- centered  approach. 

My  bias  support  the  need  to  go  beyond  the  scientific- technical- rational 
studies  of  teaching  effectiveness  and  examine  more  closely  the  humanistic  and 
the  person  centered  approaches.   This  .does  not  negate  the  need  for  empirical- 
statistical  analysis  to  the  teaching/learning  context.    This  does  not  deny 
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that  there  exists  a  set  of  teaching  "skills'*  that  nay  enhance  the  teaching/ 
learning  process.   Wcroteachlng  and  the  Reflective* Teaching  Model 
(Cruckshank,  N.D.)  are  able  to  provide  the  tools  for  the  refinement  of  and  an 
analysis  of  these  skills.    Yet  the  humanistic  and  person- centered  paradigm  for 

l 

studying  teaching  effectiveness  Identify  a  more  complex  array  of  variables 
that  do  not  lend  themselves  to  statistical  analysis.    Hence  the  need  for 
alternative  means  of  looking  at  the  teaching/learning  process. 

RESEARCH  METH000L0GV 
To  conduct  research  within  the  humanistic  and  person- centered  paradigms 
will  demand  alternative  research  methodologies.    Elsewhere  I  have  argued  for, 
and  provided  a  rationale  for  utilizing  alternative  conceptual  frameworks  and 
the  implications  these  alternatives  would  have  for  the  field  of  Instructional 
technology  (Koettlng,  1979,  1981,  1983,  1984a,  1984b).    I  drew  heavily  on  the 
work  of  Jurgen  Habermas  91971)  and  Paulo  Frelre  (1970,  1973).    My  concerns 
remain  the  same,  i.e.  the  need  to  focus  our  attention  on  eplstemology  and 
philosophical  conceptions  of  the  process  of  schooling. 
Codification 

To  arr-'ve  at  an  interpretive  or  critical  understanding  of  schooling 
(epistemological  issues),  we  will  need,  to  question  (pose  as  problematic)  our 
common-sense  notions  of  schooling.    This  can  be  done  through  an  extensive  use 
of  video-taping  within  actual  classroom  settings. 

Instead  of  using  video  within  a  micro- teaching  and  self- reflective 
teaching  model  of  analysis,  video-taping  should  occur  during  entire  class 
periods,  over  an  extended  period  of  time.   This  video- taping  process 
constitutes  Freire's  notion  of  codification  (1970).    Codification  consists  of 
re- presenting  the  object  of  reflection  (1n  this  case,  the  classroom  teaching 


ERIC 


448  441 


10 

experience)  to  the  subjects  (teachers/ students).  In  a  form  Identifiable  to 
them,  and  related  to  their  experience.   For  example,  Frelre  used  photographs 
and  drawing's  depicting  the  existential  situations  of  the  people  with  whom  he 
worked.   The  visuals  used  were  familiar  to  Ms  subjects  because  they  contained 
situations  and  events  based  on  the  subject's  own  descriptions  of  their 
Mfe-s1tuat1ons.   These  codified  visuals  become  the  objects  that  mediate  the 
subjects  In  their  critical  analysis  (decod1f1cat1on).  The  codifications  become 
"cognizable  objects,  challenges  towards  which  the  critical  reflection  of  the 
decoders  should  be  directed"  (Frelre,  1970,  p.  107).   The  cognizable  objects, 
visual  representations  of  the  subjects  1n  life- situations,  posed  as  problems 
to  subjects,  depict  the  situational  Ity  of  trie  subjects.   Self- reflection  upon 
this  situational Ity  1s  reflection  about  the  very  "condition-  of  existence, 
namely,  "critical  thinking  by  means  of  which  men  discover  each  other  to  be  '1n 
a  situation-  (Freire,  1970,  p.  100).    When  this  situation,  or  context,  Is 
seen  as  an  "objective- problematic  situation",  subjects  reach  the  stage  wherein 
the  ability  to  intervene  in  the/r  self- formative,  historical  context  becomes  a 
poss-'bil  ity. 2 

This  process  of  codification  will  keep  us  focused  on  the  person  of  the 
teacher  (bel  lefs- practice/self- reflection  on  the  sel f- formative  process- 
person- centered  paradigm)  and  allow  us  to  use  classroom" settings  "as  is"  for 
data  gathering.    We  will  then  use  Freire' s  theory  of  dialogics  in  decodifying 
the  individual  teacher' s/studenf  S3  understanding  of  the  schooling  context. 
Theory  of  Dialogues 

Freire' s  theory  of  dialogics  can  be  most  effectively  examined  through 
naturalistic  inquiry.    Dialogue  1s  the  'encounter  between  men   mediated  by 
the  world,  in  order  to  name  the  world"  (Freire,  1970,  p.  76).    There  are 
certain  conditions  required  of  subjects  who  enter  Into  dialogue: 
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1.  a  profound  love  of  Individuals 

2.  humility 

3.  an  Intense  faith  1n  man  (this  1s  an  a  priori  faith  1n  the  person) 

4.  trust  (established  through  dialogue) 

5.  hope  (rooted  1n  the  person's  Incompleteness,  and  recognition  of 
that  Incompleteness;  constant  search) 

6.  critical  thinking  (Frelre,  1970,  pp.  78-82). 

These  requirements  demand  total  commitment  to  the  process  of  dialogue 
from  those  who  choose  to  enter  the  dialogic  relationship.   They  are  neither 
na've  nor  unworkable.    They  become,  for  subjects  engaged  1n  emancipatory 
praxis,  a  basic  orientation  to  life. 

The  term  critical  thinking,  as  a  necessary  element  1n  dialogue,  needs  to 
be  pursued  and  delineated  further.    Critical  thinking  1s  thinking  which 
discerns  and  Indivisible  solidarity  between  the  world  and  men  and 
admits  of  no  dichotomy  between  them  —  thinking  which  perceives 
reality  as  process,  as  transformation,  rather  than  as  static 
entity  —  thinking  which  does  not  separate  Itself  from  action, 
but  constantly  Immerses  Itself  1n  temporality  without  fear  of  the 
Hsks  involved.    Critical  thinking  contrasts  with  naive  thinking, 
which  sees  'historical  time  as  a  weight,  a  stratiflcatln  of  the 
acquisitions  and  experiences  of  the  past,'  from  which  the  present 
should  emerge  normalized  and  ' well-behaved.'    For  the  naive  thinker, 
the  important  thing  is  accomodation  to  this  normalized  'today.'  For 
the  critic,  the  important  thing  is  the  continuing  transformation  of 
reality,  1n  behalf  of  the  continuing  humanizatlon  of  men  (Freire,  1970, 
p.  81). 
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Dialogue  requires  critical  thinking  and  1s  capable  of  generating  critical 
thinking.   Communication  1s  based  on  dialogue,  and  education  Is  based  on 
communication.    Communication  1s  concerned  with  meaning,  understanding. 
Concern  for  meaning  and  understanding  centers  our  efforts  within  the 
humanistic  and  person- centered  paradigm  for  research. 

This  process  of  dialogue  Identifies  the  power  relations  within  the 
classroom.    Siared  responsibility  for  what  goes  on  1s  vitally  Important.  The 
dialogue  focuses  on  "what  do  we  want  to  happen  1n  here,  what  Is  actually 
happening  1n  the  classroom,"  and  "what  are  the  possibilities  for  Individuals 
to  affect  change  1n  their  dally  lives." 
Decod1f1cat1on 

The  process  of  decodifying  an  Individual  teener's/student's  understanding 
of  the  schooling  context  consists  of  teacher- student,  students- teachers 
reflecting  critically  (dlaloglcs)  on  the  mediating  object  (In  this  case,  the 
video-tape  of  their  classroom  situation),  thus  externalizing  their 
understandings  of,  and  consequently  making  explicit  their  "real  consciousness" 
of  the  schooling  situation.    During  this  time,  through  dialogue, 
interpretations  are  challenged  and  understandings  questioned,  constantly 
posing  the  object  of  discussion  as  problematic.    Through  this  process  of 
consciousness  raising,  subjects  can  arrive  at  a  greater  awareness  of  the 
social  context  which  forms  their  lives,  and  also  create  awareness  of  their 
capacity  to  intervene  and  transform  1t  (cf.  Frelre,  1970,  pp.  100-108). 

The  process  of  decoding  the  mediating  objects  under  analysis  thus 
consists  in  investigation  Qf  the  subjects'  thinking  concerning  their  life- 
situation.    Personal  understandings  become  educational.   At  the  same  time  "all 
authentic  education  Investigates  thinking"  (Frelre,  1970,  p.  101). 
Investigating  the  subjects'  thinking  leads  to  further  Investigation,  hence 
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education  and  personal  understanding  are  "simply  different  moments  of  the  same 
process"  (Frelre,  1970,  p.  101). 

When  subjects  begin  to  make  explicit  their  views  of  the  world,  they 
begin  to  see  how  "they  themselves  acted  while  actually  experiencing  the 
situation  they  are  now  analyzing,  and  thus  reach  a  'perception  of  their 
previous  perception' "  (Frelre,  1970,  p.  108).   Achieving  this  awareness, 
reality  Is  perceived  differently:    "By  broadening  the  horizon  of  their 
perception,  they  discover  more  easily  1n  their  'background  awareness*  the 
dialectical  relations  between  the  two  dimensions  of  reality."    Thus  the 
orncess  of  decodlf  1cat1on  brings  about  new  perceptions  and  the  development  of 
"new  knowledge"  (Frelre,  1970,  p.  108). 

The  framework  within  which  the  decodlf Icatlon  process  could  take  place 
would  be  philosophical  1n  nature,  I.e.  concerned  with  the  theory/professed 
theory  of  the  teacher  (beliefs/practice).    Analysis  of  the  philosophical  base 
of  the  teacher  regarding  beliefs  about  learners,  the  purpose  of  schooling,  the 
notion  of  knowledge,  what  1s  of  value,  the  nature  of  social  relations  within 
the  classroom,  etc.,  could  all  be  areas  for  analysis.   What  1t  1s  teachers/ 
students  say  regarding  schooling,  and  what  they  actually  do  can  be 
dramatical  ly  re-presented  to  them  through  video-tape.    If  there  1s 
dlscrepency,  it  will  become  evident  (level  of  awareness),  and  although  a 
changed  or  more  informed  praxis  cannot  be  guaranteed,  the  opportunity  for 
positive  change  1s  present.    In  short,  this  form  of  analysis  would  allow  us  to 
explore  the  culture  of  a  particular  classroom,  and  would  keep  us  directly 
i  with  In  the  person- centered  paradigm  of  teaching  effectiveness.4 

CONCLUSION 

There  are  valid  alternative  frameworks  for  analyzing  school  problems/ 
issues.    I  believe  1t  to  be  1n  the  Interest  of  the  field  of  Instructional 
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technology  to  broaden  Its  theory-base  and  explore  other  literature  within 
education  and  to  Integrate  different  theory/practice  within  our 
conceptualizations  of  the  field.   Different  frameworks  for  defining  the 
process  of  schooling  ask  different  questions  for  research.   The  field  of 
Instructional  technology  has  much  to  offer  the  general  field  of  education 
The  research  potential  1s  great. 
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FOOTNOTES 


1.  This  section  of  my  paper  on  Teaching  Effectiveness  Research  comes 
from  chapter  five  "Teaching  Effectiveness  Research:   Implications  for 
Professional  Development".  1n  the  book 

Looking  At,  Talking  About,  and  living  with  Children:  Reflections  on 
the  Process  of  Schooling,  by  Russell  I.  Dobson.  Judith  E.  Dob  son,  and  J. 
Randall  Koettlng  (in  press,  fall,  1985). 

t 

2.  Frelre's  Education  for  Critical  Consciousness  (New  York:   The  Seabury 
Press),  1973,  gives  examples  of  visuals  used  1n  the  codification  process.  For 
a  detailed  discussion  of  the  cod1f1cat1on/decod1f1cat1on  prqcess,  see  Frelre's 
Pedagogy  of  the  Oppressed  (New  York:    The  Seabury  Press),  1970,  chapter 
three. 

3.  Frelre's  notion  of  "teacher- student  with  students- teachers'1  suggests 
the  shared  responsibility  that  exists  within  the  classroom  setting.  The 
teacher  1s  student,  and  the  students  are  teachers.   This  1s  not  a  problem  of 
semantics,  but  a  reality.   We  learn  from  each  other. 

4.  I  believe  Elliot  Eisner's  (1979)  notion  of  educational 
connolsseurshlp/ educational  criticism  1s  Important  here.    See  also  Dobson, 
Dobson  and  Kcsslnger  (1980),  who  propose  a  model  for  Staff  Development  that 
examines  an  individual's  philosophical  beliefs  and  teaching  practice. 
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Abstract 

This  study  sought  to  determine  if  an  interactive  video 
system  of  instruction  taught  CPR  (cardiopulmonary  resusci- 
tation) as  effectively  as  traditional  instruction.  Using 
standards  of  the  American  Heart  Association,  the  study  was 
designed  with  two  randomized  groups  to  be  taught  either  by 
live  instruction  or  by  interactive  video.    Both  groups  were 
taught  theory  and  skills  of  basic  life  support  including 
single  rescuer  (heartsaver),  two  rescuer,  obstructed  airway 
and  infant  rescuer.    Following  instruction  and  practice, 
separate  CPR  evaluators  tested  individuals  from  either  group 
without  knowing  the  type  of  instruction  they  had  received. 
For  both  the  written  test  and  the  performance  of  heartsaver 
skills  on  the  first  attempt,  there  was  no  significant  dif- 
ference between  traditional  CPR  instruction  and  instruction 
by  interactive  video.    Additionally,  the  interactive  video 
system  taught  obstructed  airway  in  basic  life  support  better. 
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EFFECTIVENESS  OF  INTERACTIVE  VIDEO  TO  TEACH 
CPR  THEORY  AND  SKILLS 

This  study  was  initiated  in  response  to  a  request  by 
the  American  Heart  Association  lo  validate  If  an  interactive 
video  system  of  CPR  instruction  taught  as  effectively  as 
traditional  instruction.    The  rationale  for  development  of 
the  interactive  video  system  was  based  on  the  need  for  greater 
availability  of  CPR  instruction.    No  matter  how  extensive 
campaigns  have  been  to  train  instructors,  approximately  the 
same  number  of  individuals  enter  as  instructors  each  year  as 
the  number  leaving.    The  demand  for  CPR  courses  has  often 
been  greater  than  their  availability  (Nelson  and  Brown,  1984). 
Chances  against  having  a  trained  CPR  rescuer  in  the  United 
States  have  been  18  to  1  (Hon,  1982).    To  provide  a  supple- 
mental means  of  instruction,  a  mediated  format  was  sought 
with  the  aid  of  instructional  technology.    An  effective  system 
of  instruction  could  be  applied  to  round  out  public  and  pro- 
fessional needs  for  CPR  instruction. 
Background  \ 

The  value  of  training  large  numbers  of  individuals  in 
CPR  skills,  is  well  established.    Mortality  statistics  and 
their  circumstances  support  large  scale  CPR  instruction  in 
populations.    Annually,  about  640,000  persons  in  the  United 
States-  die  from  ischemic  heart  disease  and  approximately 
350,000  of  these  occur  outside  hospitals  (White,  1982). 
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The  majority  of  cardiac  arrests  occur  in  the  home  (St.  Louis. 
1982)  making  evident  a  need  for  family  members  and  others  to 
have  CPR  background  to  draw  upon  in  the  event  of  an  emergency. 
Even  with  effective  community  services,  prompt  CPR  efforts 
by  those  at  the  scene  could  make  a  great  difference  in  the 
condition  of  victims  of  arrest  and  unconsciousness. 

Across  the  country,  communities  vary  in  their  ability  to 
handle  emergencies  and  to  instruct  residents  in  CPR.    Cost  is 
always  a  factor  and  people  have  to  be  motivated  to  take  time 
out  of  busy  schedules  to  prepare  for  an  emergency  that  they 
may  never  face.    Professionals  are  in  a  position  to  identify 
and  influence  target  groups  about  CPR  instruction  and  to  im- 
plement a  practical  plan.    Sousa  (1982)  reported  an  organized 
approach  used  in  the  Connecticut  school  system.    CPR  and 
first  aid  instruction  were  incorporated  into  the  working  day 
of  teachers  and  staff.     Cost  included  the  salaries  for  nurses 
who  provided  the  Instruction,  salaries  for  substitute  teachers 
so  that  the  regular  teachers  could  be  released,  and  cost  for 
materials.     St.  Louis  (1982)    reported  another  target  group 
in  Washington.    Physicians  were  surveyed  to  determine  their 
CPR  recommendations  for  spouses  of  heart  patients.  Findings 
showed  that  only  l\0%  of  physicians  interviewed  recommended 
CPR  instruction  for  spouses.     Physician  education,  ease  of 
access  to  instruction  and  being  able  to  fit  the  instruction 
ir.  with  Job  schedules  may  be  influencing  factors. 
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With  the  need  for  readily  available  CPR  instruction  apparent 
over  the  years,  a  variety  of  self  learning  and  media  augmented 
strategies  have  been  devised. 

Strategies  of  Instruction 

Research  reports  of  CPR  instruction  have  compared  the 
effectiveness  of  teaching  strategies  on  cognitive  and  skill 
performance  and  have  also  looked  at.  retention  of  knowledge 
and  skills  over  time.    Safar  et  al.  (1981)  reported  a  study 
initiated  in  1973  in  which  adolescents  were  taught  CPR  through 
live  instruction,  a  self  training  system,  repeated  film  view- 
ing without  manikin  practice, and  the  self  training  system 
with  film  viewings.    The  self  training  system  taught  as  effec- 
tively as  live  instruction  and  better  than  repetitive  film 
viewing.    The  self  training  group  was  tested  for  skill  per- 
formance at  3  and  12  months  post  instruction  with  a  decline 
to  50%  or  less  of  students  passing  skills  by  12  months.  In 
another  study  (Gombeski,  Effron,  Ramirez  and  Moore,  J982) 
participants  completed  either  an  eight  hour,  3  session  course 
or  a  four  hour  single  session  course  and  were  tested  for  cog- 
nitive and  skill  retention  after  one  year.    While  skill 
performance  was  below  certification  level  for  both  groups 
at  one  year,  knowledge  and  skills  were  significantly  higher 
ir.  .the -longer  trained  group.    Frlesen  and  Stotts  (1984)  .com- 
Dared  retention  as  a  result  of  CPR  instruction  by  lecture 
demonstration  -  return  demonstration  and  a  self  learning: 
method  that  included  use  of  slides,  audiotapes  and  programmed 
instruction  workbooks. 
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By  eight  weeks  post  instruction,  both  groups  demonstrated 
cognitive  knowledge  at  a  mastery  level.    Skills  were  below 
mastery  in  both  groups. 

Additional  course  descriptions  using  media  have  been 
reported  in  the  literature.    DeBaca  (1983)  described  a  CPR 
course  offered  to  hospital  employees  that  incorporated  the 
use  of  slides  and  audiotape  followed  by  live  instructor  de- 
monstration  and  return  demonstration.    After  a  five  month 
trial  period,  the  course  was  evaluated  favorably.    Renm  (1983) 
reported  the  effective  use  of  a  videotape  on  CPR  as  part  of 
instruction  given  to  parents  whose  baby  had  been  hospitalized. 
The  abundance  of  strategies  using  media  to  teach  CPR  over  the 
last  decade  and  longer,  suggests  wide  acceptance  that  medi- 
ated instruction  particularly  with  a  self  learning/pacing 
component  may  help  with  existing  needs  for  effective  CPR 
instruction. 

CPR  Interactive  Video 

With  recent  technological  advances,  exploring  how  tech- 
nology  could  further  facilitate  CPR  instruction  was  a  natural 
next  step.     In  1981,  Hessinger  reported  a  computer  and  video 

0 

instructional  system  developed  by  David  Hon  of  the  American 

Heart  Association  and  other  specialists.*-  The  technical  ^ 

1 

features  combined  a  Sony  LPD-1000  laser  optical  videodisc 
rlayer,  two  monitors,  a  random  access  audio  machine,  an 
adapted  Apple  II  computer  and  adult  and  infant  Laerdal  mani- 
kins wired  with  sensors  to  detect  key  CPR  skills. 
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The  videodisc  was  selected  over  videotape  because  of  Its 
rapid  random  access,  capability.    Needed  factorial  information 
could  be  displayed  without  delays  that  might  Interrupt  the 
learner's  concentration.   Immediate  feedback  could  be  provided 
to  reinforce  pertinent  Information. 

The  audiotape  device  was  engineered  to  avoid  having  to 

f 

contain  sound  on  the  videodisc  during  freeze  frames.  The 
videodisc  does  not  play  or  record  sound  unless  the  disc  is 
running.    When  sound  accompanies  a  still  picture  about  U00 
video  frames  are  used  up  every  15  seconds.'    Because  so  many 
still  pictures  w.ere  needed  for  the  large  program,  no  disc 
space  could  be  wasted.    Hence  a  random  access  audio  recorder 
was  created  (Hon,  1982).    The  CPR  instructional  design  for 
the  software  included  key  elements  of  instruction  that  would 
be  given  in  a  live  situation  such  as r  (1)  attention  gaining 
measures,  (2)  orientation  to  the  Instructional  setting,  (3) 
definition  of  terms,  (*0  organization  of  presentation  related 
to  objectives,  (5)  practice  opportunities,  (6)  redundancy 
strategies,  (7)  motivators  and  (8)  evaluation  components. 

Theoretical  Framework 
 ,  

Systems  theory  as  described  by  Von  Bertalanffy  (1969) 
and  Hazzard  (1971)  can  serve  as  a  basis  for  looking  at  CPR 
and  CPR  interactive  video  instruction.    With  the  underlying 
assumption  tha£  man  is  an  open  system,  man's  openness  can  be 
facilitated  through  CPR  techniques.     The  victim  of  cardiac 
arrest,  for  example,  becomes  unable  to  circulate ' (throughput ) 
needed  blood  supply. 
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With  stoppage  of  respirations,  life  sustaining  oxygen  rich 
air  (input)  cannot  come  into  the  system.    Carbpn  dioxide 
cannot  be  exhaled  (output)  from  the  system.    A  rescuer 
Gsecond  system)  provides  behaviors  (output)  through  compres- 
sions  and  ventilations  etc.  to  assist  the  victim's  system 
operation.    Resumed  breathing  or  appearance  of  a  pulse  in 
the  victim  would  represent  examples  of  feedback  to  the^rescuer. 

When  learning  via  interactive  video,  the  learner  as  an 
open  system  acts  on  the  closed  system  of  hardware  and  software 
rendering  it  open  (A  videodisc-b.- sed  course,  1983). 
The  learner's  behaviors  (output)  with  the  turn  on  switch  and 
light  pen  to  activate  the  menu  of  topics,  initiate  the  open- 
ness.   In  addition,  Just  as  rescuer  acts  on  a  victim's  system, 
the  learner-rfscuer  ac«-s  on  an  adult  or  infant  manikin's 
system  made  possible  by  sensors  and  interrelated  connecting 
parts.    Feedback  elicited  through  the  sensors  and  presented 
visually^on  the  monitors,  or  by  sound  or  touch,  permits  the 
learner  to  determine  if  the  objective  to  be  learned  has  been 
attained.    For  example,  when  being  instructed,  if  hand  place*  7 
mejit  for  compressions  is  correct,  the • information- appears  on 
the  monitor  and  a  specific  tone  is  sounded.    During  CPR  testing, 
these  feedback  clues  are  withdrawn  to  more  closely  simulate  an 
actual  rescue.    After  testing  feedback  is  given. 

* 

Procedure 

When  the  CPR  interactive  video  prototype  was  completed,  & 
the  American  Heart  Association  requested  a  validation  study  to 
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be  done  and  it  was  carried  out  at  a  middle  atlantic  baceal- 
lireate  school  of  nursing.    The  American  Heart  Association 
set  forth  these  requirements:  (1)  Study  population  would 
have  no  ^rereading,  had  never  been  certified  and  had  some 
basic  education  level,  (2)  instruction  would  run  six  hours 
maximum  and  might  be  giy*n  in  two  segments,  and  (3)  instruc- 
tors at  the  national  office  of  the  AHA  would  not  be  involved 
in  evaluation.    The  evaluation  requirements  included  these: 
(1)  Evaluation  to  be' given  immediately  after  classes',  (2) 
Evaluation  to  be  conducted  by  three  evaluators  who  were  CPR 
instructors  but  who  did  not  give  the  instruction,  (3)  Evalu- 
ation would  be  made  of  first  efforts  at  performance,  and  (ll) 
The  final  number  certified  on  first  performance  would  be 
recorded. 

Method 

The  present  study  was  designed  to  examine  the  learning 
outcomes  from  £PR  interactive  video  instruction  as  they 
compared  to  outcomes  from  conventional  instruction.    The  cri- 
tical question  was,  could  the  interactive  video  system  instruct 
as  effectively  as  live  instruction.    In  accord  with  Ameftcan 
Heart  Association  standards,  tkj^o  comparison  groups  of  students 
with  fifty  students  in  each  group,  were  planned  and  implemented. 
Fifty  students  of  similar  educational  background  were  to  take, 
the  interactive  video  course  singly  or  in  groups  of  three. 
Another  fifty  were  to  have  live  instruction. 
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Separate  e valuators  who  were  to  be  CPR  instructors  but  did 

r 

not  instruct  this  population,  were  to  test  students  from 
either  group  without  knowing  their  mode  of  instruction.  The 
reason  why  it  was  important  to  look  at  first  performance  was 
to  examine  the  effectiveness  of  instruction  at  the  same  point 
for  both  types  of  instruction.    For  individuals  who  had  un- 
successful first-  attempts,  additional  assistance  would  be 
offered  because  rescue  skills  need  to  be  mastered  in  order  for 
a  person  to  give  effective  help  to  a  victim  of  an  actual 
emergency . 

A  core  team  consisting  of  a  project  director  (P.D.).and 
a  research  assistant  (R.A.)  worked  cooperatively  to  obtain 
and  schedule  the  sample  populations,  arrange  for  CPR  instruc- 
tors and  evaluators,  and  provide  places  fbr  instruction.  The 
research  assistant  was  a  certified  CPR  instructor  but  did  not 
g've  instruction  or  conduct  testing  during  the  study.  The 
R.A.  was  present  when  students  learned  with  interactive  video 
and  provided  minimal  assistance  when  needed  to  overcome  a 
technical  snag  in  the  system.    As  an  illustration,  when  a 
sensor  did  not  work  in  the  prototype  manikin,  the  R.A.  helped. 
This  happened  on  a  few  occasions  as  when  the  temporary  landmark 
notch  sensor  became  unglued,  the  R.A.  showed  the  correct  loca- 
tion  or  when  the  finger  sweep  sensor  did  not  work  in  t^e 
obstructed  airway  section,  the  sweep  was  observed.    The  P.D. 
managed  research  events  with  time  lines,  established  data 
strategies  for  analysis  and  drafted  a  report  for  the  American 
Heart  Association. 
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The  population  samples  In  the  study  consisted  of  students, 
primarily  in  the  young  adult  years  between  18  and  20.  There 
were  less  than  a  dozen  learners  between  2<  and  50.    Most  of 
the  learners  were  nursing  students.    The  remainder  were  pharm- 
acy students  or  other  university  students.    Two  CPR  instructors 
taught  in  the  live  instruction  situation  and  three  evaluators 
tested  students.    The  Instructors  and  evaluators  had  been 
certified  by  the  American  Heart  Association.    Between  Septem- 
ber 1982  and  April  1983,  **8  participants  received  basic  life 
support  CPR  instruction  by  interactive  video  and  51  by  tradi- 
tional teacher  taught  instruction. 

Students  were  scheduled  in  such  a  way  that  the  time  for 

CPR  instruction  would  not  conflict  with  course  relate^  demands 

in  their  schedules.    CPR  was  not  scheduled  during  major  test 

times  such  as  during  mid  term  or  final  examinatiofT'periods . 

It  was  also  not  scheduled  during  the  holiday  periods  such  as 

Thanksgiving  and  Christmas  when  many  students  would  be  away. 

Individual  changes  in  scheduling  had  to  be  made  from  time  to 

time  due  to  illness  or  other  reasons.    When  students  cancelled 

appointments,  they  were  rescheduled.     In  the  live  instruction 

situation,  not  all  students  were  able  to  return  for  the  second 

session  at  the  same  time.    Seven  students  who  took  the  first 

session  did  not  return  for  a  second  session.    There  were  seven 

live  instruction  situations  given.    Each  of  these  consisted 

cf  two  sessions  roughly  a  week  apart,  and  testing  was  conducted 

Iiranediately  after  the^ second  session.    The  average  class  size 

f 

was  6,^3  students  for  each  instructor  with  a  range  from  six  to 
eight. 
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For  the  interactive  video  system,  students  were  scheduled  - 

Individually  and  in  small  groups.    Not  all  students  were 

i  »  * 

able  to  return  for  the  second  session  and  had  to  be  re- 
scheduled.   Some  students  who  completed  the  heart  saver       '  * 
segment  singly 9  were  scheduled  at  their  request  with  a  group  ' 
to  complete  the  orther  components  of  basic  life  support  because 
the  time  agreed  with  their  individual  schedules.    There  were 
times  when  the  system  malfunctioned  and  although  it  was  ser«* 
viced  promptly  students  had  to  be  rescheduled. 

Of  the  forty  eight  students  who  completed  CPR  instruction 
on  the  system,  approximately  four  fifths  finished  as  part  of 
a  group  of  two  or  three  students.'  An  additional  two,  did^rtot 
return  after  the  first  instruction.    Students  on  the  system  x 
finished  instruction  at  different  times  singly/  in  pairs  or  in 
groups  of  three.    Arrangements  were  made  for  testing  when  approx 
imately  six  students  were  ready  to  be  evaluated.    The  space,  of  . 
days  between  learning  and  testing  differed  for  students  with  * 
an  average  time  of  5.60  days. between  completing  CPR  instruction 
and  being  evaluated. 

Results 

For  skills,  using  a  2  tall  test  with  an  alpha  error  equal 
to  .05,  the  null  hypothesis  for  each  of  these  tests  may  be 
stated  as  follows:    There  is  no  significant  difference  between  , 
the  proportion  of  individuals  from -the  interactive  video  group 
and  the  proportion  of  Individuals  from  the  traditional  group 
who  passed  the  test. 
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Tests  were  done  to  determine  if  skill  level  differences  existed 
for  heart saver,  which  emphasizes  a  single  rescuer,  and  for 
basic  life  support  which  consists  of  skills  required  for  single 
rescuer,  two  resbuer,  obstructed  airway  and  skills  to  be  per- 
formed on  an  infant.    These  were  followed  by  testing  individual 
skill  components  of  BLS.    The  statistical  results  beginning 
with  heartsaver  are  shown/ in  Table  1. 

Table  1 

Z  Test  for  Basic  Life  Support  Components 

INTERACTIVE  VIDEO  (N=48)          TRADITIONAL  (N=5D 
COMPONENT  %  PASSED  %  FATLED      %  PASSED        %  FAILED  Z 

Single  Rescuer        60.42  39.58  4l.l8  58.82  1.95 

(Heartsaver) 

Two  Rescuer  68.75  31.25  57.78  42.22  l.lH 

Obstructed  87.23  12.77  71.11  28.89  2.04* 

Airway 

(Conscious) 

Obstructed  86.96  13.04  53-33  ^6.67  3-96* 

Airway  * 
(Becomes  Unconscious) 

Obstructed  81.25'  18.75  '        51-11  48.89  3.35* 

Airway 

(Found  Unconscious) 

Infant  43.75  56.25  '       56.82  43. 18.  -1.32 

Obstructed             70.21               £9.79          79-55  20.45  1.54 
Airway  , 

(Infant : Conscious) 

Obstructed             68. 00*  ;'•     31.91          64.44  35.56  .39 


^  Airwsy 

(Infant  Unconsc.l  ,-s) 


*   Significant  at  1.Q6 
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Statistical  tests  were  performed  on  individual  skills 
within  the  basic  life  support  instruction.    Table  1  shows 
significant  difference  in  situations  oy  an  obstructed  airway 
of  the  conscious  adult,  becoming  unconscious  and  wnen  found 
unconscious.     In  these  instance^  more  skills  were  passed  on 
first  attempt  by  students  who  learned  on  the  interactive  video 
system.    The  rejection  region  for  ^  B    .0$  is  Z  >  1.96  or 
Z£   -1.96.    Using  classical  analysis,  the  hypothesis  for  heart- 

i 

saver  cannot  be  rejected  and  it  must  be  concluded  that  there  is 
no  significant  difference  between  students  taught  by  the  inter- 
active video  method  and  those  taught  be  traditional  instruction 

For  basic  life  support,  the  hypothesis  is  rejected  for 

i 

an «»<  =    .05  and  it  may  be  concluded  that  a  significantly  greater 
proportion  of  students  taught  by  the  interactive  video  method 
passed  basic  life  support  on  the  first  testing  than, did  stu- 
dents taught  by  traditional  instruction. 

In  the  knowledge  section,  all  students  completed  a  paper  . 
and  pencil  written  examination.     The  same  set  of  '50  multiple 
••hoice  questions  drawn  from  the  American  Heart  'Association 

questions  were  answered  by  both  groups.    Mean  spores  were  as 

j 

follows:     For  the  interactive  video  group  -8 4. 35 Sand  the  tradi- 
tional  group  8?. 76,  no  sign,  dif;  at«<  =  .05  (sign  test  z  •=  1.75). 

r 

Based  on  theory  arid  skill  scores,  it  can  be  concluded 
that  for  both  the  written  test  and  the  performance  of  heart- 
saver  skills    on  the  first  attempt,  there  was  no  significant 
difference  between  traditional  CPR  instruction  and  interactive 
vid<*o.     Obstructed  airway  was  taught  better  by  "interactive 
video. 
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Summary 

This  was  a  study  to  determine  if  interactive  video  could 
teach  CPR  as  effectively  as  traditional  instruction.  Groups 
of  randomly  assigned  individuals  were  taught  using  the  two 
methods.    Results  showed  that  no  significant  difference  existed 
between  interactive  video  instruction  and  traditional  instruc- 
tion in  both  skills  and  knowledge  with  the  exception  of  obstruc 
ted  airway  in  the  adult.    The  interactive  video  system  taught 
skills  for  obstructed  airway  In  the  adult  significantly  better. 
The  implication  is  that  a  technological  means  of  instruction 
such  as  interactive  video  can  be< a  valuable  adjunct  in  helping 
to  meet  present  demands  for  CPR  courses.    Future  research  is 
planned  and  will  reflect  this  baseline  research  to  validate 
the  system.     Variables  such  as  learner  differences,  time  and  ' 
retention  factors,"  cost ^factors  as  well  as  diverse  content  * 
applications  for  interactive  video  need  to  be  addressed  further 
In  .the  present  study  it  took  approximately  6  to  .8  hours  for 
basic  life  support  in  both  groups  including  certification. 
Discovering  influencing  variables  related  to  'time  should  be 
pursued.     Retention  studies  need  to  focus  on  both  cognitive 
and  skill  areas.     Affective  responses  need  also  to  be  examined. 


»  f 
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THE  EFFECTS  OF  SELECTED  VARIABLES 
ON  LEARNING  A  SPATIAL  VISUALIZATION  TASXi 
A  REPORT  OF  RESEARCH  IN  PROGRESS'  % 


This  paper  describes  -a  systematic  research  .program  that 'has  been 
designed  to  study  the  cumulative  effects  of  selected  instructional 
variables  on  learning  a  spatial  visualization  task.   The  three  studies 
described  in  the  paper  are  "in  progress",  they  have  not  been  completed 

Backgrounds  t  ' 

.  Biggins  developed  a  self-instructional  programmed  text  to  teach 
Air  Force  cadets  to  read  aircraft  instruments  and  identify  pictures  of 
aircraft  in  the  positions  indicated  on  the  instruments.    A  sample  item 
from  the  criterion  test  used  to  assess  the  effectiveness  of  the 
instructional  program  is  presented  in  figure  1.    The  instructional 
program  included  directions  for  reading  the  instruments  and 
practice/feedback  on  identifying  'aircraft  iri  the  positions  indicated 
on  the  instruments.    The  program  was  highly  effective  when  used  with 
the  all  male  ROTC  cadets  fbr  whom  it  was  designed.   Cadets  who 
participated  in  the  field  test  on  the  program  had  mean  percentage 
scores  of  53%  correct  on  a  nine-item  pretest  and  87%  correct  on  a  36 
item  posttest  (Biggins,  1975). 

in  1983  Biggins  adapted  the  Aircraft  Instrument  Comprehension 
program  to  a  slide-tape  presentation.    The  slide-tape  program  included 
the  same  direct  instruction  and  practice  used  in  the  programmed  text. 
The  instruction  in  the  slide-tape  program  is  presented  orally  at  a 
fixed  pace  with  no  opportunity  to  review  information  once  it  is  - 
presented.    The  slide-tape  version  of  the  AIC  program  has  been 
presented  to  several  groups  of  students,  mostly  females,  enrolled  in 
teacher  education  programs  at  Arizona  State  University.  Mean 
percentage  scores. for  these  groups  on  a  10  item  pretest  have  ranged 
from  33%  to  34%  correct.    Mean  percentage  scores  for  the  groups  on  a 
20  itep  posttest  range  from  63%  to  68%. 

The  studies  that  follow  are  designed  to  identify  instructional 
variables  that  will  improve  the  performance  of  female  students  on  tile 
AIC  test,  i 
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Problem  Statement: 

This  study  is  designed  to  determine  the  individual  and  combined 
effects  of  two  different  perspectives  (subjective  and  objective)  and 
tiro  different  sequences  (attitude  first  or  beading  first)  for 
presenting  cues  in  the  Aircraft  Instrument  Comprehension  program.  It 
;  is  hypothesized  that  presenting  cues  that  start  from  the  learner's 
"  subjective  point  of  view  (zero  degree  camera  angle)  and  progress  to  an 
objective  point  of  view  (45  degree  to  180  degree  camera  angle)  trill  be 
the  more  effective  procedure  for  naive  learners  learning  to  read 
aircraft  instruments; 

*  a 

,  ■ 

Backgrounds  ^ 

Gibson's  (1947)  studies  of  the  use  of  line  drawings  with 
distortions  of  distinctive  features  to  teach  aircraft  identification 
and  his  use  of  zero  angle  (subjective  point  of  view)  to  teach  gunnery 
skills  to  aviation  cadets  is  an  early  effort  to  understand  how 
audiovisual  techniques  can  be  used  to  present  effective  instructional 
cues.    Roshal  (1949)  demonstrated 'the  superiority  of  zero  degree 
c*nera  angle  (subjective  view)  over  a  180  degree  camera  angle  (eztreme 
objective  point  of  view)  for  presenting  cues  needed  to  perform  a  knot 
tying  task.  This  study  eztends  the  previous  research  to  a  complex 
spatial  visualization  task. 

Methods: 

Subjects: 

Female  elementary  education  majors  enrolled  in  IME  411  in 
the  Department  of  Educational  Technology  will  serve  as  subjects. 

Materials: 

Four  versions  of  Biggins'  AIC  sound-slide  program  will  be 
produced  for  this  study.    In  the  first  program,  the  learner  will  be 
oriented  to  read  the  instruments  from  "inside"  the  aircraft  pictured 
(subjective  orientation).    In  this  program,  the  attitude  indicator 
will  be  presented  first  because  it  can  be  read  from  a  subjective 
orientation  without  having  to  mentally  rotate  the  aircraft  pictured; 
then  the  heading  indicator  will  be  presented.    The  secord  program  will 
combine  the  subjective  oriented  cues  with  a  heading  then  attitude 
sequence.    The  third  progras  will  combine  objective  oriented  cues 
(cues  oriented  from  outside  the  aircraft)  with  an  attitude  then 
heading  sequence.  Storyboard  samples  of  the  four  programs  are 
presented  in  Figure  2.  The  fourth  program  presents  objective  cues  with 
a  heading  then  attitude  sequence. 

Procedures: 

A  post test-only  control  group  experimental  design  will  be 
used.    Subjects  will  be  randomly  assigned  to  one  of  the  four  treatment 
groups.  Each  group  wili  meet    separately  to  view  their  version  of  the 
instructional  program.    The  criterion  test  will  be  administered  at  the 
conclusion  of  the  instructional    program.  Subjects'  posttest  scores  on 
the  AXC  test  will  be  analyzed  using  analysis  of  variance  (AKOTO) 
procedures. 

2  4?2. 


Study  2 
Kimberly  Koenigs 


Problem  Statements  . 

This  study  is  designed  to  examine  the  effects  of  pre- instruct ion 
on.  performance  of  a  spatial  visualization  task.    Pre- instruct Ion  will 
be  used  to  familiarize  participants  with  the  futures  (front,  back, 
right/left  sides)  and  rotations  (Fitch,  bank,  and  heading)  of  an 
aircraft* 

Background t  s 

Two  studies  have  been  identified  which  directly  relate  to  the 
hypothesis  tuat  use  of  a  pre-instruetional  program  will  significantly 
raise  the  scores  of  naive  learners  on  the  AIC  criterion  test.  Ives  and 
Rakow  (1983)  found  that  when  children  use  pictures  to  solve  rotation 
.tasks  and  are  required  to  rotate  objects  with  inherent  feature 
descriptions,  their  performance  is  significantly  lower  than  when 
objects  with  inherent  features  are  used  or  when  language,  which 
supplies  a  feature  description,  is  used.  Seddon,  Eniaiyeju,  and  Jusoh 
(1984)  found. that  remedial  instruction  which  made  use  of  concrete 
models,  shaded  diagrams  and  simple  media  animation  techniques  were 
effective  in  teaching  Nigerian  students  (predominantly  teenage  males) 
to  identify  chemical  molecules  in  various  positions  of  rotation. 

Methods: 

Subjects! 

A  sample  group  of  150  undergraduate  college  students  will 
participate  in  this  study. 

Materials s 

A  series  of  slides  will  be  prepared  to  present,  in  split 
screen  format-  instruction,  practice,  and  feedback  relating  to 
perspective  aircraft  features  and  rotations.    An  audiotape  will 
supplement  the  slides  by  providing  oral  instructions,  prompts,  and 
feedback  related  to  the  illustrations  of  aircraft  presented. 

Procedure: 

A  post test-only  control  group  experimental  design  will  be 
used.  The  experimental  group  will  be  presented  pre-inst ruction,  the 
AIC  program,  the  AIC  post  test,  and  an  attitude  questionnaire.  The 
control  group  will  be  presented  the  AIC  program,  the  AIC  post  test,  and 
the  attitude  questionnaire. 

The  AIC  posttest  scores  will  be  statistically  analyzed 
using  analysis  of  variance  (ANOVA)  procedures.  Response  to  the 
attitude  questionnaire  will  be  analyzed  to  determine  if  students  found 
the  pre-inst ruction  to  be  helpful  in  performing  the  AIC  task. 
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Study  3 
Randall  R.  Molina 


Problem  Statement?  mm  m  ,  . 

This  study  is  designed  to  determine  the  effectiveness  of  imagery 
instruction  on  learning  a  spatial  visualization  task.  The  effects  of 
visualisation  demonstration  and  visualisation  practice  on  learner 
posttest  performance  will  be  examined.  The  differential  effectiveness 
of  the  imagery  strategy  for  subjects  with  high  and  low  visual  ability 
will  be  determined. 

Backg  round i 

Seddon,  Eniaiyeju,  and  Jusoh  (1984)  investigated  the  effects  of 
visualization  instruction  on  learning  to  identify  illustrations  of 
chemical  molecules  in  various  positions  of  rotations.  Subjects 
who  received  instruction  in  visualizing  the  effects  of  rotation 
performed  significantly  better  on  a  Rotations  Test  than  a  comparison 
group.  They  also  determined  that  a  10  degree  stepsize  using  .dissolves 
between  slide  changes  was  significantly  more  effective  than  larger 
stepsizes  and  abrupt  slide  changes. 

Methods s 

Subjectst  f  , 

The  sample  will  consist  of  120  undergraduate  education 
majors  enrolled  in  an  Instructional  Media  Education  course  randomly 
assigned  to  one  of  four  treatment  groups. 

Materials! 

The  materials  will  consist  of  a  series  of  slides  which  (a) 
demonstrates  how  to  use  a  four-step  procedure  to  construct  a  mental 
image  of  an  aircraft  in  the  position  indicated  on  aircraft 
instruments!  and  (b)  provides  practice  using  the  four-step 
visualization  procedure.  The  visualization  instruction  will  be 
embedded  in  the  most  effective  version  of  the  AIC  program  produced  in 
the  previous  two  studies.  Treatment  combinations  of  visualization 
demonstration  and  practice  will  be  prepared.    Two  levels  of 
visualization  demonstration  (presence  and  absence)  and  two  levels  of 
practice  (presence  and  absence)  will  be  completely  crossed. 

Procedures! 

The  Cards  Rotations  Test  will  be  administered  prior  to 
initiating  th    experiment.  Subjects  will  view  the  AIC  program  then 
complete  a  twenty-item  criterion  posttest  and  a  brief  questionnaire. 
A  Posttest-Qnly  2X2  factorial  experimental  design  will  be  used. 
Figure  4  illustrates  the  experimental  design.  A  univariate  analysis  of 
variance  will  be  performed  to  determine  the  individual  and  combined 
effects  of  demonstration  and  practice  on  posttest  scores.    Data  from 
the  spatial  visualization  ability  test  and  the  post-instruction 
questionnaire  will  be  correlated  with  posttest  scores.  A  significant 
difference  is  expected    for  confirmation  of  the  hypothesis  that 
imagery  instruction  which  includes  both  visualisation  demonstration 
and  visualization  practice  can  improve  learner  posttest  performance  on 
a  spatial  visualization  task. 
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Field  Independence - Dependence 


The  purpose  of  the  study  was  to  determine  the  effects  . 
of  multiple  end  linear  visual  presentation  end  cognitive 
style  on  performance  in  a  visual  location  task.    The  stuuy 
also  considered  whether  the  scores  in  a  visual  location  task 
were  affected  by  the  interaction  of  presentation  mode/  ^ 
(multiple  and  linear  image  presentation)  and  of  cognitive 
style  (Field  Dependent  and  Field  Independent). 

Most-  of  the  research  on  field- dependence- independence 
has*  been  conducted  by  Witkin  and  his  associates  and  is 
summarized  in  a  1977  issue  of  the  EfiXifiH  fif  Educational 
Research  (Witkin,  et  „al. ,  1977).     Field  independents  (FI) 
can  give  structure  to  unstructured  material  and  can  separate 
an  item  from  its  overall  context.     Field  dependents  ( FD)  on 
the  other  hand  tend  to  respond  holistically  to  stimuli. 
Compared  to  FI's,  FD's  have  a  greater  need  for  and  are  more 
dependent  on  external  sources  of  structure  and  organization. 

When  recalling  information,  the  thought  strategies  of 
TO' s  and  FI's  vary  greatly.     Field  dependents  are  not  likely 
to  depart  from  the  dominant  arrangement  of  the  total  visual 
as  given,  and  tend  to  remember  the  most  noticeable  cues, 
whether  or  not  they  are  relevant.     Information  recall  in 
FD's  is  facilitated  if  major  visual  cues  are  made  relevant 
and  is  hindered  if  important  cues  are  irrelevant  or  if 
relevant  visual  cues  are  not  salient.     Field  Independents  s' 
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tend  to  be  able  to  identify  the  mos$  important  visual  cues 
whether  or  not  they  are  the  most  important  (Wilkin,  et  al.  , 
1977). 

In  recent  years  the  field  of  instructional  media  has 
begun  to  develop  an  empirical  base  which  combines  certain 
unique  medium  (visual  ) characteristics  and  psychological 
requirements  of  specific  leaning  tasks  (Allen  1974).  The 
existing  empirical  base  is  lacking  with  respect  to  multiple 
presentations,  perceptual  types,  i.e. ,  cognitive  style,  and 
visual  location  tasks. 

The  /typical  f ormat  $i  visual  image  presentations  has 
consistently  bfeen  linear.     Since  it  appears  Field  Dependent 
individuals  may  have  difficulty  in  mental  retention  of  a 
visual  from  image  to.  image,  the  linear  format  of  visual 
presentations  may  be  inappropriate.    Honfce,  it  may  be  that 
the  format  of  large  amounts  of  the  existing  visual-  material 
would  not  be  effective  for  FD  individuals.     If  the  use  of 
multiple  imfye  presentation  enhances  the  ability  for* the  FD 
individual  to^leam  visual  tasks,  then  the  design  of 
instructional  media  may  be  made  beneficial  for  FD's.  Since 
the  FI  individual  seem  to  have  the  ability  to  retain  visual 
images  mentally,  multiple  image  presentation  may  not  result 
in  significantly  diUJerent  performance  than  linear  imagery 
in  a  visual  location  task.    However,  it  would,  seem 
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reasonable  to  expect  that  multiple  image  presentation  would 
reduce  the  visual'  task  factor,  for  FX's  as  well  as  for  FD's. 
If  data  can  be  produced  which  supports  the  idea  that  for 
certain  learning  tasks  and  certain  cognitive  types,  a 
specific  format  is  effective,  then  instructional  developers 
would  be-  able  to  utilize  the  results  in  alternate  media 
design  (Whitley  and  Moore,  1979). 

Subjects 

The  subjects  of  this  study  were  150  undergraduate 
college  students  enrolled  in  professional  education  courses. 
One  hundred,  thirty  two  (132)  students  (40  male,  92  female) 
completed  accurately  alls  phases  of  the  experiment.  These 
subjects  were  identified  as  field  dependents,  field 
independents  and  neutral  by  means  of  the  QX3HE.  Embedded 
Figures  Test  (GEFT),  (Wilkin  et  al,  1971).     Since  the  test 
manual  stt  no  guidelines  for  grouping,  subjects  were  grouped 
into  the  above  categories  in  approximate  thirds  according  to 
their j scores  ^'  i.e.  ,  scores  of  IS  and  above  were  classified 

as  Fl!(N=47),  11  tu  14  as  neutral  (9=45)  and  those  with 

i 

score^  of  10  and  below  as  field  dependents  (N«40).     The  GEFT 
has  a  range  of  scores  from  0-18.    A  median  split  was 
rejected  because  of  the  closeness  of  low  FI  and  Jiigh  FD 
scores.  / 
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Materials 

The  experiment  used  a.  visual  location  task  and  Was 
designed  to  test  the  subjects  ability  to  select  a  criterion 
picture  from  a  group  of  three  similar  pictures  after  viewing 
three  quadrants  (in  random  order)  of  the  criterion  picture. 
These  pictures  (15)  represented  a  variety  of  pictorial 
sty: as  and  were  selected  from  instrument  designed  by  Whitley 
.,(1978).     Two  treatments  were  developed.    All  pictures  and 

s 

quadrants  were  made  into  Black  and  White  2X2  slides,  to 
eliminate  the  additional  factor  of  color.    They  were  then 
videotaped  via  a  film  chain,  in  a  television  studio. 
Treatment  ore  (linear)  presented  each  quadrant  of  the 
criterion  picture  separately  for  two  (2)  seconds,  one  after 
another.     The  criterion  picture  was  then  presented  with  the 
two  similar  pictures  for  a  total  of  six  (6)  seconds.  In 
treatment  tvo  (multiple)  each  of  the  quadrants  were 
presented  simultaneously  on  the  screen  for  a  period  of  six 
(6)  seconds..    As  in  the  first  treatment,  the  criterion 
pictures  were  then  presented  with  the  other  two  similar 
similar  pictures  for  six  (6)  seconds,  The  criterion  score 
was  the  total  number  of  correct  choices  (0-15).  The 
pictures  used,  chosen  by  a  panel,  the  criteria  of  similar 
content,  detail  and  format.    Both  treatment  groups  saw  the 
exact  same  stimuli  materials. 
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groccdurt 

The  expe.     mt  wee  conducted  in  two  phases.    In  phase 
one,  the  subjects  were  given  the  Group  mmddld  gjgyxta 
XsiU*    This  is  a  timed  test  and  takes  approximately  20 
minutes  to  conduct.    The  reliability  of  this  test  is  .82 
(Wit kin,  et  si.  ,  1971).    Phase  two  took  place  on  a  separate 
day  and  subjects  were  randomly  placed  into  the  linear  or 
multiple  treatments  groups.    Subjects  viewed  the  assigned 
treatment  in  groups  of  eight  or  less  and  viewed  the  same 
television  screen  (25")  from  approximately  the  same  distance 
and  under  similar  conditions.    Because  both  treatments  were 
videotaped,  timing,  and  lighting  etc.  was  held  constant. 
The  subjects  indicated  on  the  answer  sheet  (optical  scan)  if 
the  criterion  picture  was  the  first,  second  or  third 
picture.     The  total  correct  answers  were  the  dependent 
variable  and  the  subjects  had  scores  ranging  from  0-15.  A 
3x2  analysis  of  variance  was  used  to  test  the  following 
hypotheses:  there  is  no  (1)  significant  difference  between 

o 

the  criterion  scores  of  FI's,  neutrals,  PP's,  (2) 
significant  difference  between  the  mean  scores  of  the 
subjects  viewing  the  multiple  end  linear  presentations,  (3) 
significant  interaction  of  student  mean  scores  between 
cognitive  style  and  presentation  mode  in  a  visual  location 
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task.  The  independent  variables  were  presentation  mode  and 
cognitive  .tyl..  ^     .  ( 

Results 

A  summary  table  of  the  factorial  analysis  of  variance 
based  upon  the  table  of  means  (see  Table  1)  is  presented  in 
Table  2.    As  can  be  seen,  the  college  students  depending 
upon  their  classification,  as  FI,  neutral  or  FD  performed 
significantly  different  F(2,131)=7. 91,  p=.0006  on  the  visual 
location  task.    A  secondary  analysis  using  the  Duncan's 
Multiple  Range  Test  indicated  that  FI's  (X=10.553)  and 
Neutrals  (X=9. 533)  hsih  scored  significantly  higher  than 
FD's  (1=8.200).     Table  2  also  indicates  that  presentation 
mode  (linear  vs.  multiple  presentation)  was  not 
significantly  different  F( 1, 131)*0. 79,  p=0. 3747  in  this 
study.     In  addition,  there  was  no  significant  interaction 
between  presentation  mode  and  cognitive  style  T(2,131)  =  «^,li 
p=0. 4033.     The  fact  that  FI's  mean  scores  was  significantly 
higher  than  FD's  was  predicted.     However,  the  results  which 
indicated  there  were  no  significant  difference  in  treatment 
groups  was  surprising.    Added  to  this  fact  that  FD's 
actually  had  higher  mean  scores  on  the  linear  presentation 
(1=8.333)  than  on  the  multiple  presentation  (1=8.053)  was 
unexpected.     Both  FI's  and  neutrals  had  higher  mean  scores 
on  the  multiple  treatment  than  on  the  linear  presentation. 
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INSERT  TABLE  1  and  TABLE  2  ABOUT  HERE. 


"  Discussion 

Because  of  the  characteristics  of  FX  and  FD  subjects 
described  earlier  by  Wit  kin,  it  was  expected  that  FI's  would 
acore  significantly  higher  than  FD's  on  a  visual  location  — 
task.    The  results  of  this  study  confirmed  this.    This  fact 
should  strengthen  the  premise  that  there  are  people  who  have 
the  characteristics  of  FD  and  FI  as  described  by  Wilkin  and 
that  the  GEFT  does  indeed  identify  these  individuals  with 
those  characteristics.    As  noted  earlier,  it  was 
hypothesized  that  a  multiple  presentation  of  three  quadrants 
would  be  beneficial  to  FD  types  in  selecting  the  criterion 
picture,  because  all  visual  information  would  be  on  the 
screen  at  one  time  and  not  separated.    Howell  (1972)  in  an 
comparison  of  Lowenf old's  Haptic-Visual  theory  and  Wit kin's 
Field  Dependent -Independent  theory,  suggested  that  Visual 
types  and  Haptic  types  (from  Lowenf  el  i)  tend  to  match 
respectively  Field  Independent  and  Field  Dependent  types 
(from  Witkin).    Whitley  and  Moore  (1979)  reported  that  the 
Haptics  scored  significantly  higher  with  a  multiple 
presentation  of  a  visual  location  task  than  with  a  linear 
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presentation.    However,  these  findings  were  totally  reversed 
and  in  this  present  study  and  the  mean  scores  of  FD 
individuals  were  actually  higher  for  the  linear  presentation 
than  the  multiple  presentation.    Whitley  and  Moore  (1979) 
inferred  that  multiple  image  presentation  might  tend  to 
facilitate  the  retention  and  comprehension  of  visual  cues 
for  Haptic  individuals,  thus  the  inferred  FD  types.  The 
results  of  the  present  study  may  bring  into  question  the 
close  relationship  between  Hap tics  and  Field  Dependents  as 
suggested  by  Howell  (1972)  and  thus  questions  Whitley  and 
Moore's  inferences  as  presented  earlier  in  this  paper. 

Previous  research  ^comparing  multiple  and  linear 
presentations  have  also  tended  to  produce  conflicting 
results  (Whitley  and  Moore  1979)  as  does  this  study.  It 
appears  that  there  may  be  other  factors  which  may  be 
interacting  with  presentation  mode  and  cognitive  style  which 
might  account  for  the  unexpected  results.    These  factors 
might  include  intelligence,  sex  or  experience  in  viewing 
visuals  as  well  as  others.    These  factors  should  be  studied 
in  the  future.    Until  further  results  are  presented  media 


developers  cannot  be  sure  that  multiple  visual  presentations 
will  be  of  assistance  to  field  dependent  individuals  as 
suggested  earler  in  this  paper. 
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The  author  expresses  gratitude  to  Ha.  Janice  McBee  for  help 
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Table  1 

Correct  answer  Mean*  by  Cognitive  Style  and  Treatment 


Overall 


N 

Mean 

Dependency 

> 

Field  Independent 

47 

<r        ,  • 

10.553 

Itinear 

19 

9.789 

Multiple 

28 

11.071 

Neutral 

45 

9.533 

Linear 

23 

9.435 

Multiple 

22 

9.636 

Field  Dependent 

40 

8.200 

Linear 

21 

8.333 

Multiple 

19 

8.053 

Overall  Treatment 

Linear 

63 

9.175 

Multiple 

69 

9.783 
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Table  2 


3x2  Factorial  Analysis  of  Variance 


Source 
Model 

Dependency 


Dependency 
X  Treat- 
ment 

Error 

Corrected 
Total 


DF 

5 
2 
1 


Sum  of  Squares 

139.62026 
119.77540 
6.00410 


2  13.84076 
126  953.37215 

131  1092.99242 


Mean  Square 

27.92405 


F  value 

3.69 
*  7.91*  , 
0.79 


0.91 


p  >  .001 
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*  INTRODUCTION 

.      *  \ 

V    In  the  process  of  writing  my  report  on  action  research  at  the  end  of 
a  four-year  grant/ 1  have  decided  that  my  contribution  to  ny  AECT  colleagues 
will  be  to  share  some  Insights  that  I  have  .gained,  as  a  result  of  a  broad 
range  of  experiences.   I  also  wish  to  describe  certain  methods  that  have 
proved  useful  In  the  application  of  technologies  demanding  a  great  deal  of 
participation  from  persons  Involved  1n  a  research.  1  offer  these  observations 
1n  the  spirit  of  sharing  and  discussing.  Thus  I  ask  you  not  to* consider  * 
presumptlous  my  announcement  of  new  trends s  tlfey  are  proposed  1n  the  light 
of  current  Ideas  emanating  from  the  scientific  community  and  scholars,  araong 
them  Longsheet  (1982),  Sussman  and  Evered  (1978).  •/ 

First  I  will  describe  the  manner  and  extent  to,  which  the  participation 
variable  affected  my  process  of  evaluating  an  open  model  of  pedagogy.  I 
shall  then  Indicate  some  lessons  I  have  learned  while  Investigating  various 
action  research  groups  at  university  level.   For  this  purpose  I  have  chosen 
a  case  history  from  a  research  of  my  own  and  two  from  current  action  research 
literature.   Thl  core  of  my  expose  wtil  be  the  principles  about  participation 
and  action  research  which  I. distilled  from  conducting  a  collective  writing 
colloquium  with  popular  educators.  (For  term,  see  note  ,(1)  .  further,  I  will 
show  how  a  participatory  approach  1n  action  research  can  serve  as  a  strategy" 
for  writing  a  script,  research  proposal,  course  outline  or  project  evaluation. 

Finally  I  will  discuss  the  need  to  use  action  research,  to  bridge  the 
gap  between  practice  and  theory. 

-  *  \ 

I  .    The  Participation  Variable 

Let  me-  state  here  that  I  consider  action  research  a  worthwhile  research 
paradigm  in  the  field  of  Instructional  technology.   In  areas  such  as  needs 

* 
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assessment,  curriculum  development  and-  Innovation,  action  research  1s  «s 
valid  and  productive  as  the  more  favored  systems  approach,  which  has  been 
considered  the  rational,  organized  and  experimental  mode  of  evaluation  and  - 
revision.   In  the  latter  approach,  targeted  populations  were  relegated  to 
the"  role  of  prospective  customers  rather  than  that  of  participants,  tty 
experiences  have  led  me  to  support  action  research.  > 

In  1973  I  was  faced  with  the  dilemma  of  evaluating  an  open  model  of  ^ 
teaching  without  adequate  Instruments.   Required  to  evaluate  yii  equally 
obliged  to  avoid  disturbing  or  manipulating  any  variable,  I  turned  with 
some  of  ny  colleagues  to  ethnographic  tools  to  examine  the  pedagogical  field 
and  ultimately  determine  Its  significance.  At  the  end  of  the  research  period 
I  made  a  suwnaryV  report,  or  analysis  (MoHn,  1979,  1980).   To  my  astonish- 
ment, I  discovered  that  we  had  omitted  from  our  assessment  process  some 
Important  evaluation  components.  Why?  We  had  wanted  to  change  the  environ- 
ment but  we  had  failed  to  InvoTve  the  students  as  participants  In  the  change 
process.   Eventually  we  Constructed  a  model  tha  we  called  anthropopedagog- 
1cal:   anthropo  because  we  were  employing  ethnographic  tools,  mainly  parti- 
cipant observation,  and  pedagogical   because  an  educator  1s  active  In  the 
"field, ^Intervening  and  working  as  a  change  agent.  This  Implies,  moreover, 
that  the  teacher  facilitates  student  Involvement  1n  both  their  learning, 
environment  and  evaluation.    If  decisions  are  to  be  mwnlngful,  they  should 
aim  to  change,,  as  often  as  necessary,  the  objects  and  resources  In  an 
educational  setting  to  render  1t  more  supportive  and  productive.  Hence 
students  must  participate  1n  the  totality  of  their  learning  experience  . 

I  narrated  ind  publicized  my  research  findings  in  a  poster  session  1n. 
1979  at  the  AECT  convention  1n  New  Orleans.   I  then  decided  to  explore  alter- 
native  research  methods,       formative  evaluation  model  suggested  two 
possible  directions,  forcing  me  to  deepen  the  ep1 sterol og leal  roots  of  ray 
position7.   One  orientation  was  to  function  as  an 'ethnographer  in  .education; 
and  the  second  was  to  focus  on  action  research  Itself,  that.  1s,  analysis  qf 
an  act        search  model. 
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P  Actually  I  •*as  Identifying  the  theoretical  foundations  of  my  action 

research  model  so  It  might  serve  as  more  than  a  purely  operational  mode  to 
solve  Immediate  problems.   I  aimed  at  producing  practical  knowledge,  or 
savoir-faire,  uhlch  ultimately  wculd  permit  an  educator  to  perform  routine 
tasks  more  easily  and  solve  Issues  that  consume  much  energy,  making  the  work 
of  teaching  and  learning  more  laborious  than  It  needs  to  be.  f 

On  the  one  hand  I  wanted  to  broaden  my  application  of  ethnography  1n 
education  to  a  broader  cultural  dimension;   I  strove  to  understand  the  link 
between  macroscopic  and  microscopic  v1ews\of  phenomena  and  events.  This 
j  dimension  has  been  explored  1n  some  of  the  research  studies  I  have  directed, 
but  at  the  present  time  it  has  not  yst  been  Associated  with  action,  research. 

I  w*r,  +empted  also  to  examine  the  various  ways  action  research  1s 
conducted   ^  different  parts  of  the  world.   In  my  search  for  models  of  action 
research  and  data  analysis,  I  was  curious  to  ascertain  to  what  extent  action 
research  findings  could  find  credibility  1n  the  scientific  world.   I  knew 
that  criteria  for  an  action  research  paradigm  would  enable  us  to  judge  whether 
a  research  study  remained  faithful  to  Its  original  methodology  and  whether  a 
gain  1n  knowledge  may* be  expected. 

Thus  for  four  years  I  have  lived  a  sort  of  professional  schizophrenia. 
Half  of  me  has  aligned  Itself  with  colleagues  in  my  field,  asking  me  to  be 
faithful  to  the  definition  of  Instructional  technology  expounded  1n  my 
Los  Angeles  graduate  courses  (Tick ton,  1971). 

(Instructional  technology)  1s  a  systematic  way  of 
designing,  carrying  out,  and  evaluating  the  total 
process  of  learning  and  teaching  1n  terms  of  specific 
objectives,  based  on  research  1n  human  learning  and 
communication,  and' employing  a  combination  of  human 
and  non-human  resources  to  bring  about  more  effective 
Instruction.      (P.  21) 

The  other  part  of  me  affirmed  my  trust  1n  a  field  approach  characterized 
by  the  participant-observer  tradition,  drawn  notably  from  practical  anthro- 
pology (Bastlde,  1971).  This  part  of  m  looked  for  ways  to  Intervene  1n  the 
field  more  as  participant  than  observer,  yet  always  preoccupied  with  the 
acquisition  and  production  of  knowledge. 
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Although  this  divided  aspect  of  ny  research  life  1s  apparent  1n  my 
paper,  I  have  discovered,  I  think,  some  avenues  for  enriching  the  tra- 
ditional font  of  Instructional  technology;   thus  I  am  either  cured  or  at 
least  en  route  to  reconciliation.    I  have  achieved  a  deeper  understanding 
of  the  educational  and  Instructional  research  node.      I  have  become  better 
equipped,  possessing  both  more  tools  and  a  more  refined  concept  of  action 
research,  one  which  transcends  pure  applied  research.    I  can  suggest  new  , 
ideas  to  enrich  the  systems  approach  and  an  alternate  experimental  paradigm. 

Let  me  acknowledge  that  my  comprehension  of  a  pedagogical  action  has 
been  enriched  by  the  analytical  tools  furnished  by  certain  Ideas  basic  to 
anthropology.   These  tools  have  added  clarity  and  depth  to  my  perception. 

How  ny  reflections  may  seem  to  state  generalities  but  I  relate  them 
because  they  bring  me  to  the  conviction  that  one  variable  1s  omitted  from 
too  many  research  paradi gms, namely  participation.  This  component,  which  1s 
essential  1n  action  research,  1s  also  vital  1n  certain  developmental  models 
of  Instructional  design.   Me  must  remember  that  a  research  study  always  emerges 
from  a  context,  although  experimentalists  seem  most  at  ease  in  a  context- 
free  laboratory;   they  are  normally  not  preoccupied  that  their  research 
findings  be  reintegrated  with  their  appropriate  contexts.    In  all  types  of 
research  a  certain  degree  of  contextual  participation  exists  but  1n  action 
research  context  1s  essential. 

I  wish  to  emphasize  my  beliefs  about  context  anc  participation, recon- 
ciling these  with  deductive  reasoning,  rationality  and  the  systems  approach. 

II      Lessons  from  the  Field:   Toward  Reconciliation 

In  recent  years  ny  research  experiences  have  been  numerous  and 
varied,  both  frustrating  and  encouraging,,  but  always  enlightening  in  some 
way  or  another.    In  this  part  I  will  discuss  briefly  some  studies  in  differing 
action  research  fields  at  university  level  and  the  study  of  a  collective 
writing  experience  with  popular  educators.    I  will  then  Indicate  the  lessons 
about  action  research  gained  from  these  Investigations,  noting  especially 
the  participation  variable. 
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2.1     Investigations  In  Differing  Research  Fields  at  the  University  Level 

I  have  Investigated  several  research  projects  that  claimed  a  basis 
1n  either  ethnomethodology  or  action  research.   Since  ay  observations  will 
be  treated  at  length  1n  another  paper  I  will  merely  Indicate  the  material 
pertaining  ^participation  as  seen  1n  two  case  studies. 

1.   The  PRIM 

The  PRIM  case  was  a  study  at  University  du  Quebec  a  Montreal  (UQAM) 
called  "Projet  de  recherche  et  d' Intervention  a  la  ma1sonn,or  "Research 
Project  on  Intervention  1n  the  Home". 

The  research  group  dealt  with  a  first  cycle  program  for  training  special 
education  teachers  and  social  workers  to  help  parents  of  children  younger 
than  five  years  to  acquire  the  skills  and  evaluation  expertise  needed  to 
cope  with,  accept  and  educate  these  children.   Trainees  were  assigned  two 
families  each.   The  trainees  were  students  who,  after  a  few  weeks  of  briefing, 
worked  for  several  weeks  with  assigned  families  and  returned  to  the  university 
to  share  Ideas  and  experiences.   PRIM  researchers  tried  to  analyse  results 
and  weigh  the  program's  value.  'They  claimed  that  action  research  was  their 
principal  approach;  for  this  reason,  I  decided,  after  reading  their  project, 
to  study  their  model. 

When  we  began  to  listen  to  them,  we  discovered  that  they  were  using 
an  experimental  paradigm  and  were  trying  to  verify  four  hypotheses.  They 
were  also  1n  the  process  of  constructing  measuring  Instruments  and  trying 
to  find  control  groups.   Their  data  later  seemed  to  show  no  significant 
difference  between  control  groups  and  those  receiving  attention.    It  was 
obvious  to  me  however,  in  the  light  of  high  parental  satisfaction  and  trainees' 
enthusiasm,  that  a  more  adequate  measuring  Instrument- was  lacking,  one  which 
would  discern  Information  other  than  behaviors. 
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The  PRIM  researchers  assumed  their  conclusions  were  right  because 
their  Instruments  had  been  validated  and  also  considered  reliable.   How  then 
could  they  justify  the  expenditure  of  continued  energy  to  sustain  this 
superb  practice- to- theory  project?  Their  teaching  model  was  action  research 
Inspired,  Intended  to  encourage  Interaction  between  society  and  the  university 
to  serve  social  needs. 

i 

We  noted  that  even  though  experimental  measures  could  detect  some 
results,  the  experimental  paradigm  could  not  discern  and  demonstrate  the 
changes  1n  parental  attitudes,  their  participation  1n  the  training  and 
evaluation  of  the  children,  and  the  university  students  '  high  degree  of 
satisfaction. 

Hence  we  recommended  more  qualitative,  ethnographic  measures,  and  methods 
based  on  action  research.   Trainees  must  be  encouraged  to  submit  many  examples 
and  descriptions  of  their  activities.  We  proposed  that  Increased  student 
participation  was  a  major  step  toward  Improving  the  research  model,  at  the 
same  time  providing  more  data  for  analysis.    Ethnographic  and  action  research 
methods  which  demand  participation  could  offer  Important  clues  to  the 
resolution  of  their  research  dilemma. 

We  delayed  offering  our  advice,  however,  because  a  problem  developed 
which  taught  us  a  salient  lesson.   The  observer  we  sent  to  the  PRIM  became 
increasingly  and  capably  Involved  In  the  management  of  the  group,  almost 
taking  over  leadership  at  one  point.   Aggress1v1ty  arose,  leaving  the  group 
unsure  about  Its  Identity.    From  that  error  we  learned  that  whenever  a  group 
asks  for  expertise  1n  participation  or  action  research,  negotiation  1s 
essential.  The  whole  research  group,  not  merely  Its  leader,  must  work  on 
what  I  call  an  open  contract. 

A  second  lesson  concerns  the  fact  that  action  research  .although  un- 
appreciated 1n  the  scientific  world,  finds  sympathetic  acceptance  from  many 
administrators  and,  Increasingly,  with  social  agencies  willing  to  grant 

funds. 
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Finally,  I  think  1t  1s  high  time  we  stated  action  research  criteria 
so  researchers  will  not  label  their  methodology  action  research  merely 
because  they  involve  themselves  with  their  subjects  or  carry  out  activities 
that  normally  do  not  fall  under  the  heading  of  research. 

2.   The  Ford  Teaching  Project 

The  Ford  Teaching  Project  which  originated  at  the  University  of  East 
Anglla  1n  England,  was  a  genuine  action  research  from  the  beginning  (Adams, 
Elizabeth,  1980;  Elliott,  John,  1980).    Its  underlying  assumption-was  that 
teachers  will  change  their  behaviors  only  to  the  extent  that  they  are  both 
aware  and  critical  of  the  theories  behind  their  practices.   Moreover,  the 
teachers  must  be  Implied  1n  the  construction  of  theories. 

From  elementary  and  secondary  schools,  Ford  researchers  recruited 
forty  teachers  who  taught  differing  subject  matters.    It  was  accepted  that 
increased  self-knowledge  would  enrich  the  teachers'  exploratory  and  Investi- 
gative methods  of  teaching. 

Coordination  was  done  by  a  team  of  these  researchers  whose  mandate  was 
to  develop  methods  and  instruments  useful  1n  the  collection  of  data;  this 
central  office  took  over  the  chore  of  making  generalizations. 

At  the  beginning  only  one  teacher  evaluated  himself /herself  signifi- 
cantly.  In  the  end,  twenty-five  participants  made  significant  changes  1n 
judging  their  approaches  to  discovery  teaching  methods  and  assessing  their 
own  personalities.   Eight  had  dropped  out  of  the  project.   The  teachers' 
involvement  led  to  the  development  of  many  hypotheses,  some  already  verified 
and  others  still  1n  the  testing  stage. 

To  me,  a  sal1eirtM)Olnt  1s  that  the  Ford  paradigm  demanded  full 
participation  by  Its  subjects.   Participation  ,then,  Induced  changes  in  the 
teachers  because  they  became  Increasingly  conscious  of  their  self knowledge. 
Nevertheless,  the  practical  theories  the  researchers  actually  observed  through 
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behaviors  and  attitudes  are  not  considered  scientific  truths  because  there 
are  more  hypotheses  than  totally  controlled  variables.   The  research  model 
Inspired  bytewln  is  a  spiral  wherein  each  pace  can  be  observed,  applied, 
evaluated  and  corrected  before  the  next  step  1s  made:   an  "action  circle" 
which  In  turn  generates  the  same  pattern  of  observation,  application,  assess- 
ment and  correction. 

The  Ford  research  may  be  called  a  spiral  ?  embedded  1n  the  complexities 
of  classrooms  at  the  elementary  and  secondary  levels  of  many  schools.  Both 
effects  and  process  are  observed:   In  a  way,  the  problems  are  observed 
while  solutions  are  applied  In  the  teaching  practice.   These  problems  may 
seem  minor  to  the  anthropologist  or  program  developer.   Nevertheless,  just 
as  each  cell  1n  the  human  organism  must  receive  nourishment  from, and 
communicate  through ^nembranes  with  other  cells  to  avoid  the  growth  of  tumors, 
1n  the  same  maimer  each  teaching  problem  deserves  attention  and  solution 
when  a  need  develops. 

Promoters  of  the  Ford  action  research  model  stipulate  two  conditions, 
or  criteria  for  proper  functioning:   first,  the  situation  must  relate  to  a 
teacher's Me\6  of  action;   and,  second,  the  teacher  must  be  1n  a  position 
to  effect  wanges  1n  his  or  her  situation. 

In  an  action  research,  participation  demands  conditions  that  are  linked 
to  the  action  itself:   1f  the  field  of  action  1s  too  big  it  discourages 
involvement;   1f  1t  1s  outside  the  participant's  field  of  competence,  1t 
destroys  motivation  and  Interest. 

Another  Important  co,,-1derat1on  in  this  model  is  that  clarification 
of  the  problem  1s  an  ongoing  process  during  the  analysis  phase  as  well  as 
In  the  exploratory  phase. 

The  second  step  In  the  Ford  research,  following  Identification;  1s  that 
of  "reconnaissance" .which  presupposes  a  good  description  of  the  situation  to 
further  clarify  the  problem.  After  problems  are  classified,  this  step  begins 
to  offer  perspectives  which  were  not  originally  foreseen.   From  that 
evolves  a  search  for  explanations  and  the  genesis  of  hypothesis  development. 
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Subsequently,  working  hypotheses  shed  light  on  other  Information.   As  long 
as  hypotheses  guide  action,  the  analytic  process  can  be  maintained. 

The  third  step  1s  to  establish  a  plan  of  action,  such  as  determining 
how  much  one  has  to  negotiate  to  Implement  the  plan,  and  what  resources  are 
needed.  At  this  stage  a  rational  approach  aimed  at  systematizing  the  action 
seems  advisable. 

Research  which  Implies  participation  poses  the  problem  of  deontology^ 
To  what  extent  can  Information  be  diffused?  The  answer  must  be  elicited  from 
those  directly  Involved  In  the  project. 

The  Ford  research  model  Implies  the  use  of  ethnographic  tools  such  as 
participant  observation.   In  order  to  achieve  optimum  objectivity,  promoters 
Insist  on  the  necessity  of  trlangulatlon  of  data.   Their  Intention  1s  not 
only  to  corroborate  points  of  view  but  also  to  find  correspondences.  Thus 
one  can  compare  data  from  a  teacher,  his  or  her  students,  and  an  external 
observer. 

This  model,  inspired  by  Rappaport's  definition  of  action  research,  1s 
interesting  because  It  does  not  remove  us  too  far  from  the  search  for  objec- 
tivity.  Yet  1t  1s  adventurous,  involving  a  search  for  signification,  for 
meanings, and  it  permits  a  great  sense  of  induction. 

One  may  judge,  however,  that  the  knowledge  generated .rich  as  it  1s, 
stm  lacks  generalization.   Does  this  really  matter  1f  It  generates  lessons, 
hypotheses  for  Improvement  and  enrichment  of  the  context  of  teaching  models, 
and  necessary  Insight  Into  teachers'  personalities  and  lifestyles?  Such 
learning  1s  Insightful,  useful  and  practice lv  ~ 

As  I  see  it,  however,  the  teachers  were  expected  to  be  active  partici- 
pants 1n  the  Ford  project,  but  not  to  the  extent  that  we  shall  see  in  my 
analysis  of  the  next  case,  in  which  the  participant  actors  became  authors. 

2.2    investigation  in  a  Collective  Writing  Experience  with  Popular  Educators 
Involving  subjects  in  all  phases  of  an  educational  research  is  probably 
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en  unattainable  Ideal,       Investigation  of  case  studies  —  of  which  I  report 
only  two  here  —  draws  attention  to  the  fact  that  action  research  carries 
various  definitions  and  serves  as  a  vehicle  for  many  purposes  and  types  of 
studies. 

Hy  disappointment  In  university  studies  which  I  believed  too  Imitative 
of  traditional  scientific  models  led  me  In  1982  to  do  a  study  that  Involved 
jnpular  education*1*  groups.   I  searched  for  authentic  action  and  Innovative 
pedagogic  strategies   (Korin.  1984).  , 

Hy  team  accepted  as  an  operational  definition  of  action  research  the 
premise  that  the  authors,  namely,  the  researchers,  and  the  actors,  or 
practlctloners,  must  be  reciprocally  Involved.  The  authors  participate  1n 
the  action  and  the  actors  function  to  some  extent  as  authors.  Thus  an  action 
research  focused  on  the  practitioners  themselves,  their  actions  and  their 
transactions.   Its  aim  1s  to  rationalise  spontaneous  practice. (Desorches .1982) 

If  Its  aim  Is  to  rationalize,  are  we  not  skirting  with  the  systems 
approach  of  developmental  research,  which  tries  to  Integrate  and  systematize 
human  and  material  resources  In  order  to  promote  and  facilitate  learning? 
No.  we  are  not.  While  the  aim  1s  the  same,  the  means  differ.   In  action 
research  auto-d1agnos1s  Is  an  essential  antecedent  to  auto-prognosis.  In 
action  research,  the  process  operates  on  as  well  as  bv  means  of  the_actors: 
they  form  the  study  group;  their  benefit  1s  the  research  object;  and  only 
with  their  fullest  participation  can  their  goals  be  attained. 

Acceptance  of  the  need  for  participation  may  not  have  been  recognized 
by  university  researchers  because  the  university  1s  a  hierarchical  micro- 
society  of  a  wider  hierarchical,  though  democratic,  society.  Further, 
assuming  that  the  process  of  learning  belongs,  to  the  learner,  1t  Is  hard  to 
believe  that  a  student  does  not  ultimately  retain  more  when  he  or  she  has 
helped  conceive,  organize  and  assimilate  material  than "when  1t  all  comes 
prepackaged.   Is  not  evaluation  also  more  meaningful  and  acceptable  to 
the  student  when  he  or  she  has  played  a  determining  role? 
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Acting  on  these  assumptions,  we  decided  to  become  better  Informed  about 
persons  and  self-help  groups  who  banded  together  to  teach  themselves  or    ,  s 
solve  specific  problems  without  Institutional  formalities,  and  often  without 
support  from  funding  bodies.   For  more  than  a  decade,  popular  education 
groups  have  thrived  1n  Quebec  and  Canada  and  are  now  organized  In  a  national 
association.'  Some  groups  have  a  fragile  existence,  while  others  enjoy  a 
sturdy  lifespan.   I  had  noted  In  their  Inter-group  meetings  they  had  manifested 
the  need  to  record  their  histories  and  experiences.   Hence  my  research  team 
decided  to  organize  a  colloquium  for  them  In  which  they  would  collectively 
answer  that  expressed  desire.   Recruitment  of  popular  education  practitioners 
would  be  drawn  from  more  than  six  hundred  groups  1n  Quebec  and  at  least  two 
hundred  In  the  other  nine  provinces.  They  would  become  writers  about  their 
own  experiences  on  topics  that  they  themselves  would  choose. 

Six  months  before!  the  event  we  sent  a  preparatory  questionnaire  asking 
each  prospective  participant  to  describe  his  or  her  groups'  objectives  and 
principal  activities.  He  requested  some  background  Information  about  either 
the  person  or  his/her  group.   Writing  this  resume*  was  already  a  first  step 
in  writing;  1t  also  allowed  people  to  know  each  other  a  month  before  the 
colloquium,  since  each  participant  received  the  resume  of  worxshop  colleagues. 
Over  two  hundred  fifty  Inscriptions  permitted  u§  to  form  fifteen  collective 
writing  workshops  organized  around  twelve  themes. 

1.     The  Writing  Techniques 

We  then  prepared  for  our  animators  four  collective  writing  techniques 
to  use  with  the  groups;  each  workshop  was  free  to  decide  whether  or  not  to 
use  them.  These  techniques  were  designed  to  facilitate  verbal  exchange  and 
^writing.    In  addition,  each  workshop  was  assigned  a  resource  person  based 
on^theme,  as  well  as  a  participant  observer  who  could  serve  as  secretary. 
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These  techniques  qualify,  I  believe,  as  elements  of  new  methodology 
for  new  trends  1n  action  research-.  The  first  technique  1s  called  the/j 
"echo-writing  strategy11.   Its  aim  1s  to  write  an  editorial  on  a  given  theme, 
the  group  stays  together  for  the  first  hour  and  a  half.  Two  persons,  who 
agree  to  play  the  role  of  editorialists,  take  notes  during  the  meeting.  Over 
lunch  they  write  a  first  draft  or  jot  down  analytical  reflections  about  what 
has  been  said.   Ideally  the  resource  person  meets  with  them  too.  They  then 
read  their  draft  or  analysis  to  their  group,  which  reacts,  corrects,  evaluates 
and  eventually  suggests  the  content  of  a  second  draft.  One  of  the  group's 
members  may  edit  the  final  text.  The  group  then  continues  to  a  second  theme 
and  a  third  one  If  time  permits, using  the  same  process. 

The  second  technique  1s  named  the  "cyctm  writing  strategy".   After  a 
group  has  become  acquainted  1t  selects  four,  questions  to  be  answered  during 
their  two  days  together.   Divided  Into  four  subgroups  they  explore  these 
questions  for  thirty  minutes,  briefly  discussing  content  matter  and  suggested 
titles  for  each  question.  Then  each  four-member  subgroup  assumes  responsibility 
for  one  question.  Two  from  each  group  stay  with  that  question  for  the  next 
two  days  while  the  other  two  discuss  for  the  first  hour  and  a  half,  then 
visit  each  of  the  other  three  subgroups  for  ninety  minutes  to  provide  feed- 
back. The  original  two,  meanwhile,  receive  members  of  the  other  subgroups 
in  succession.  All  the  Itinerants  return  to  their  original  group  for  the 
last  hour  and  a  half.  They  now  can  perceive  the  transformation  of  their 
Initial  responses  and  also  convey  Ideas  that  have  been  discussed  1n  the  other 
three  groups.  A  final  general  meeting  permits  them  to  draw  up  some  proposi- 
tions and  to  refine  their  final  texts. 

Although  this  technique  seems  complicated,  1t  was  used  successfully  by 
three  groups  at  our  colloquium,  adapted  to  suit  their  specific  needs. 

The  third  technique,  called  "nucleo  writing",  1s  a  traditional  one, 
except  that  1n  a  phase  called  feedback,  two  persons  meet  another  subgroup 
and  are  replaced  by  two  from  another  one. 
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As  far  as  popular  educe  tors  are  concerned,  X 'am  sure  that  these  tech- 
niques work;  they  can  enabli  groups  to  express  their  rich  experiences  1n  a 
manner  that  can  prove  profitable  to  each  other  or  as  lessons  for  similar 
groups.  ' 

Since  the  techniques  were  prepared  by  instructional  technologists, 
however,  they  proved  a  bit  Intimidating  to  some  persons.   Had  the  popular 
educators  participated  1n  thfir  design,  I  am  sure  they  would  have  been  both 
more  appropriate  and  smooth-  to  apply. 

2.      Lessons  Drawn  from  this  Experience 

-     As  Instructional  technologists,  we  learned  from  this  collective  writing 
research  project.(2)   Although  the  colloquium  took  two  years  from  preparation 
to  the  publication  of  Its  acts,  1t  offered  some  disappointments,  quite  frankly, 
to  my  team  SESOE  (French  acronym  for  Group  Studying  Open  Systems  In  Education). 
On  the  plus  side,  we  gained  valuable  Insights  which  may  be  considered  guide- 
lines for  eliciting  greater  participation  1n  an  action  research. 

First  lesson:   Action  research  demands  negotiation  that  leads 
^        to  commitment 

•  The  first  condition  concerns  negotiation.   As  university  professors,  or 
researchers,  it  appears  preferable  to  be  Invited  by  the  subjects  to  parti-  * 
dpate  1n  an  action  research  rather  than  to  be  Initiators.  A  professional  who 
has  mastery  over  a  body  of  pertinent  scientific  knowledge  may  conduct,* 
satisfying  and  satisfactory  study.   But  1n  action  research.  Intervention  by 
a  university  professor  may  provoke  or  perpetuate  conflict,  at  least  1n  ny 
own  province,  Quebec.   I  refer  especially  to  groups  who  oppose  Institutions 
and  their  representatives,  however  sympathetic  they. may  be.    In  collective 
writing  Researchers  must  motivate  persons  to  disclose  their  personal  expe- 
riences and  write  about  their  activities;   they  must  take  enough  time  for 
sensitization.  When  a  researcher  Is  recognized  as  a  competent  facilitator 
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who  will  favor  dialogue  leading  up  to  the  final  writing,  he/she  will  be 
invited.   In  our  case,  we  should  have  spent  two  years  In  long  tern,  prepa- 
ration and  another  year  of  Matt  work.  Thus  we  could  havev.chleved  the 
goal  of  every  action  research:  an  open,  flexible  contract  based  on  mutual 
reflection,  congruent  with  the  life  and  dynamics  of  the  groups  cooperating 
1n  the  research. 

It  is  essential  that  negotiation  occur  before,  during  and  after  an 
action  research  (Plrson.  Arteel.  etc.  1980).   In  an  experience  such  as  ours, 
for  example,  the  support  of  the  base  or  representative  persons  of  target 
groups  Is  vital. 

These  representatives  should  hold  key  jobs  at  the  organizational  level 
and  be  treated  as  equals,  becoming  as  It  were.  In  business  parlance,  "share- 
holders".  Negotiation  1n  action  research  leads  to  a  special  kind  of  contract, 
one  which  1s  enunciated  1n  the  next  condition  or  principle. 

second  Lesson:  Action  research  requires  an  open  contract. 

When  launching  this  venture  we  Intended  to  put  on  the  program  only  the 
themes  or  content  matter  suggested  by  members  from  popular  education  groups 
who  answered  our  questionnaire.  At  that  point  our  contract  was  open.  Although 
we  retained  the  questions  as  proposed,  participants  were  still  free  to  change 
and  reorient  them.  '  However  we  should  have  Intervened  by  trying  to  understand 
better  the  meanings  of  these  suggested  themes  through  Informal  meetings  with 
some  representatives;  thus  we  could  have  Improved  the  problematic  aspects 
of  each  theme. 

To  open  up  a  problematic  Issue  means  that  one  must  also  give  the  - 
concerned' party  a  chance  to  resolve  It.  we  had  Invited  persons  to  do  collective 
writing,  assuming  that  they  understood  what  would  be  expected  because  we  had 
written  to  them  four,  five  or  even  six  times  about  collective  writing.  He^ 
believed  that  the  technical  work  of  organizing  the  group  experience  fell 
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Into  our  range  of  expertise.   What  we  failed  to  account  for  was  the  significance 
of  collective  writing  to  popular  educators.    Inadvertantly  we  had  closed  our 
co it  act  before  the  colloquium  without  knowing  1t.  This  1s  the  price  a  re- 
searcher can  pay  by  not  working  every  day,  1n  the  field. 

People  may  want  to  Innovate  but  they  change  slowly.   During  the 
colloquium  participants  began  to.reflect  on  the  event  Itself.   Host  of  them 
accomplished  the  responsibility  they  had  agreed  upon  but  a  third  of  the  work- 
shops, refused  to  produce  a  written,  or  some  form  of  permanent,  document. 
(They  had  been  provided  the  means  of  producing  a  statement  1n  any  media  of 
their  choice.)  The  lesson  1s  clear:   besides  giving  participants  a  voice  In 
shaping  the  problems  they  will  address,  a  second  way  to  favoi  communication 
is  to  make  sure  that  Intentions  and  general  objectives  are  adequately  under- 
stood, accepted  by  all  participants,  and  amenable  to  modification  when  necessary 
Otherwise  one  may  encounter  challenge  1n  various  forms,  such  as  argumentlveness, 
resistance  or  refusal  .to  participate,  or  suspicions  of  manipulation.  Avoiding 
such  "adversity11  1s  necessary  to  good  action  research,  but  mastery  of  the 
right  strategies  usually  comes  with  experience.  We  recognized  belatedly  that 
not  only  should  content  be  chosen  1n  an  endeavor  like  our  colloquium,  but  - 
the  process  leading  to  consensus,  as  well  as  a  generous  measure  of  Initiative,' 
must  be  accorded  to  participants.  t 

Third  Lesson;   Action  research  must  be  a  mytual  quest  for 
significations. 

• 

We  Intended  the  colloquium  to  fit  Into  the  context  of  a  research.  To 
be  more  precise,  we  WSnted  to  learn  about  action  research  Itself  and  about  Inno- 
vative actions  and  reflections.   We  learned  more  about  participation  through 
the  organizational  experience  than  from  Its  content. 

Our  participants  ultimately  wished  to  exchange  Ideas  orally,  we  disco- 
vered, since  they  attached  foremost  significance  to  dialogue.   We  had  aimed 
at  making  them  write  their  Ideas  down;   it  became  clear  that  they  did  not 
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assign  equal  value  to  our  Indention. 

Let  us  look  at" alternative  research  stances.  The  posftlvlst  view  of 
action  research  is. that  distance  wist  be  maintained  between  the  object  and 
the  research  subject.   In  other  words,  the  researcher  must  keep  himself  out 
of  the  scene  as  much  as  possible.   I  disagree  with  this  viewpoint.  In 
action  research  the  author  must  go  beyond  pure  phenomenologlst  knowledge,  al- 
though he  may  be  part  of  the  dynamics,  even  1f  blurring  should  occur  between 
objective  and  subjective  poles.  The  action  researcher  wants  praxeology, 
that  1s,  insight  about  an  action  through  experience  with  It,  He  gains 
understanding  both  from  practice  and  In  the  practice  Itself. 

Thus,  the  colloquium  taught  us  new  ways  of  Implementing  participative 
tools.   The  four  writing  techniques  which  we  suggested  were  channels  1n  which 
we  Incorporated  the  Desroche  process  (1978)  to  give  people  a  chance  to  express 
their  experiences,  write  about,  evaluate  and  compare  them,. and  finally  suggest 
propositions.  -Our  technical  ^strategies  may  have  seeded  strange  and  scholarly; 
fcut  our  animators'  handling  of  the  techniques  permltted-works hoppers  to 
modify  them  according  to  specific  needs,  (tecasionally-eoamunication  was 
aggressive,  but  serious  reflection  leads  me  to  believe  that  this  release  was 
healthy.   Perhaps  1t  was  even  *  sign  that  despite  Individual  differences  and 
misunderstandings,  the  final  acceptance  by  a  group  of  an  adjusted  format  did 
facilitate  what  we  were  hoping  to  achieve. 

We  are  convinced  that  in'  future  research  we  must  choose  our  Instru- 
mentation with  utmost  care;  above  all,  we  must  involve  participants  1n. 
everysstage,  as  we  have  previously  emphasized.   I  think  this  is  the  most 
satisfactory  way  of  ensuring  that  we  delineate  our  Intentions  so  that  each 
.  group  will  cooperate.^  optimum  mutual  advantage. 

Fourth  lesson:  Action  research  must  transcend  the  application 

of  theory  to  practice. 

One  unmodified  Idea  too  often  voiced  when  practitioners  or  professional 
persons  speak  with  university  researchers  1s  the  allegedly  superior  value  of 
experience  over  theory.  Theory  is  considered  quite  useless;   1n  constrast,. 
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experience  Is  blindly  and  confidently  accepted.   This, generalization  cries 
out  for  nuances. 

e 

Western  Industrial  thought  since  Taylor  Is  embedded  with  the  conception 
of  labor  as  a  process  between  man  and  machine  expressed  1n  terms  ofawork 
that  1s  breakable  Into  measurable  units  of  activities.   The  prestige  of 
science  and  technology  as  well  as  operational  and  systems  theories  have 
given  birth  to  administrative  management  by  objectives  for  either  planning 
or  budgetary  policies.   Even  human  relations  technlq.ies  present  themselves 
as  a  scientific  corpus. 

Curiously,  "the  non-rat  1onal  aspects &f  management  such  as  change,  un- 
certainty, and  the  unique  character  of  each  situation  do  seem  te  concern  Its 
professionals.   Today  one  hears  talk  about  "decision  In  uncertainty**  or 
"decision  by  Intuition"   (SchOn,  1983).  Those  who  voice  these  Ideas  point 
out  the  dilemma  posed  by  rigor  and  relevance.   The  action  researcher  confronts 
opposing  camps .expressing  differing  views  of  professional  knowledge.   He  has 
reason  to  hesitate,  since  he  1s  caught  between  acting  as  a  theoHdan  who 
excels  In  this  domain,  or  as  an  artisan  working  securely  within  a  research 
framework  characterized  by  change,  Insecurity  and  uniqueness. 

a 

In  such  an  action  research  group  one  learns,  contrary  to  traditional 
instructional  technology,  not  to  be  seen  as  an  expert.   One  must  also  question 
the  definition  of  resource  person.   Participants  are  true.*  Agreement  between 
true  resource  persons  researcher  and  an  action  group  on  this  matter  1s  essential 
for  effective  communication,  since  theory  1s  not  easily  applied  in  social  and 
educational  milieux;  hence  the  researcher  cannot  expert  a  prestigious  and 
powerful  Influence  based  only  on  his  theoretical  knowledge.   The'  simple  reason 
is  that  the  researcher  has  a  great  deal  to  learn.   His  or  her  ideas  will 
eventually  come  to  light  but  they  comprise  only  one  dimension  of  knowledge. 
The  other  dimension  Is  offered  by  participants  who  express  their  needs  and 
ideas  honestly,  who  open  up  when  they  perceive  they  will  be  heard  respect- 
fully, and  their  words  win  not  be  twisted.  Thus  they  become  Intermediaries 
and  facilitators  within  a  workshop  or  action  research  activity. 
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Fifth  Lesion:   In  action  research  one  must  value  the  experience 
of  others. 

In  our  collective  writing  research,  we  made  great  efforts  to  discern 
the  experience  of  others.  For. Instance,  we  analysed  the  written  texts  produced 
by  each  workshop  to  note  complementary  Material  in  a  participant's  background 
and  the  text  he/she  helped  to  write.  We  did  a  sentence  by  sentence  content 
analysis  to  perceive  discrepancies  between  experience  and  expression.  More- 
over we  meticulously  studied,  with  the  help  of  our  participant  observers, 
the  dynamics  of  each  workshop.   Had  writers  appropriated  any  suggested  tech- 
niques? Did  their  discussions  proceed  according  to  Desroche's  logical 
steps;  that  1s.  was  the  content  matter  titled,  organized,  evaluated,  compared 
with  other  data,  and  some  propositions  enunciated?  Did  participants  think 
logically?  Was  their  reasoning  deductive  or  Inductive?  How  did  their 
expression  conform  to  their  individual  experience? 

Another  preoccupation  arising  froa.  our  colloquium  1-  the  relationship 
between  researcher  and  practitioners.  The  latter  are  not  so  much  customers 
but  coo pera tors.   Yet  calling  them  cooperators  and  authors  1n  a  collective 
writing  research  raises  questions.   If  they  can  challenge  the  researcher's 
appetence  and  expertise  do  they  not  weaken  his  authority  and  autonomy? 
Moreover  the  researcher  Is  not  the  only  one  searching,  nor  are  group  writers 
the  sole  authors;  hence  role  definitions  are  confused.    Inherent,  unexpressed 
dilemmas  point  to  a  need  for  reviewing  our  understanding  of  the  professional 
knowledge  of  researchers  (Schfin  ,  1983).  Certainly  any  challenge  to  a  re- 
searcher must  be  dene  with  the  practitioner's  awareness  of  his  or  her 
specialized  knowledge  and  experience.   In  return,  the  researcher,  having 
constructed  a  constellation  of  meanings,  must  recognize  the.  capacity  of 
field  workers  to  organize  and  assign  meanings. 

The  researcher's  actions  give  differing  messages  to  receptors.  He/she 
must  take  pains  to  make  clear  explanations  and  continue  testing  the  perceptions 
within  real  life  parameters.  Participants  1n  a  research  must  be  dialogued 
with  as  equals  so  that  mutual  understanding  of  events  1s  achieved.  Although 
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a  subject  may  not  accept  the  researcher  as  an  ultimate  authority,  they 
must  agree  to  cooperate,  withhold  judgment,  share  feelings  and  under 
standings,  and  reveal  difficulties  1n  comprehension.   Appreciation  may 
coincide  with  payment  for  the  researcher's  services.    In  return  the  latter 
must  deliver  competencies  such  as  helping  the  practitioner  understand  and 
follow  advice,  and  make  his/her  own  actions  logical  to  the  observer's  eye.  - 
Thus  with  self-examination  and  feedback  the  researcher  will  use  his/her 
professional  knowledge  to  best  advantage  1n  a  truly  open  contract. 

Sixth  Lesson:  Action  research  must  defuse  aggressive  dialogue 
and  argumentativeness. 

Of  one  thing  we  are  proud:  during  our  colloquium  nobody  in  my  re- 
search team  responded  1n  kind  when  some  participants  became  aggressive.  We 
listened  to  grievances,  responded  mildly,  and  avoided  the  games  a  few  people 
seemed  determined  to  play.   He  believed  in  compromise,  preferring  to  maintain 
a  calm  and  peaceful  atmosphere;   further,  we  monitored  our  own  failures  to 
communicate  effectively.   This  enabled  us  to  read  the  subjects'  writing 
objectively  and  to  evaluate  them  1n  the  most  positive  light.   We  tried  to 
assess  to  what  extent  each  workshop  correctly  used  suggested  writing  strategies, 
and  how  participants'  personal  and  popular  education  experiences  could  be 
traced  1n  what  they  wrote.   We  also  respected  their  wishes  by  taking  six 
months  to  get  explicit  permission  from  those  who  wished  tc  have  their  work 
published. 

Whenever  adverse  positions  affect  communication,  knowledge  and  education 
rarely  advance:   a  negative  climate  precludes  the  disclosure  and  consideration 
of  various  viewpoints.   There  1s  good  reason  behind  the  saying:   the  harvest 
1s  poor  1n  a  storm.  -  * 

With  the  publication  of  the  acts  I  recognize  that  my  two-year  experience 
has  not  only  enriched  my  team  but  made  us  better  action  researchers.  More^- 
over  the  colloquium  obviously  has  helped  at  least  one  subject  group:  after 
eight  members  of  a  senior  citizen  group  attended  the  colloquium  —  each  of  them 
working  In  a  different  workshop  —  they  were  able  to  use  one  of  the  most 
complex  writing 'strategies  to  collectively  write  up  their  grant  request. 
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Seventh  Lessons  Action  research  demands  living 

with  uncertainty  and  the  knowledge 
that  every  situation  is  unique. 

Whenever  one  begins  an  action  research  he/she  encounters 
the  risks  of  itfe  dynamics,  despite  enlightened  planning.  More- 
over one  cannot  predict  ancillary  events,  in  our  case  such  things 
as  last-minute  cancellation  by  a  major  speaker,  an  imminent  strike 
that  forced  us  to  plan  alternate  facilities  if  our  university 
closed,  reduced  access  to  support  staff,  and  some  participants 
who  were  abrasive  and  stridently  vocal.    Challenges  from  cir- 
cumstances and  participants  whose  goodwill  is  presumed  in  an 
invitational  conference  for  quasi-professionals  Is  unsettling. 
Thus  one  must  adjust  to  change  on  short  notice  and  resolve  little 
problems  before  they  get  out  of  hand. 

We  attempted  all  that  at  our  colloquium.    The  fifteen  work- 
shops began  well,  but  only  ten  achieved  our  goal  for  them,  producing 
a  collective  document.    As  a  researcher  I  tried  to  understand  the 
variables.    Was  resistance  due  to  rain,  fatigue,  personality  con- 
flicts, "the  after-effects  of  our  wine  and  cheese,  differing  expect- 
ations, or  the  level  of  animators'  competence?       Or  did  the  in- 
genuous zeal  of  a  few  who  were  promoting  causes,  and  who  read 
institutional  manipulation  into  the  structures,  divert  and  subvert 
their  peers?    I  believe,  after  careful  analysis,  that  these  per- 
sons deliberately  deranged  us.    This  was  a  factor  we  had  not  an- 
ticipated. 

Nevertheless,  responsibility  for  cooperative  and  relevant 
exchanges  lay  with  the  animators,  whose  capacities  for  dealing 
with  difficult  participants  naturally  varied.    We  were  well  served 
by  fifteen    competent  animators-,  some  of  them  superbly  gifted, 
experienced,  and  renowned.    Most  probably  the  caliber  of  each 
animator  played  a  decisive  role,  given  the  circumstances. 
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To  sun  up,  participation  is  vital  if  the  researcher  wants 
to  satisfy  clients,  engage  then  fully  in  their  own  learning 
process,  and  expand  a  research  dimension  to  its  fullest  potential. 
As  I  noted  earlier,  the  extraordinary  PRIM  project  failed  to 
elicit  significant  data  because,  I  believe,  researchers  failed 
to  modify  their  strategies  with  the  help  of  the  social  workers, 
special  education  teachers  and  parents  of  the  learning  disabled 
children. 

The  Ford  Teaching  Project,  on  the  other  hand,  realized  rather 
successfully  an  action  research  design  that  involved  observers, 
coordinators,  teachers  and  their  students.    It  may  not  have  been 
the  ideal  action  research,  eliciting  participation  at  all  levels, 
but  it  achieved  a  degree  of  participation  and  subsequent  research 
findings  that  was  satisfactory  in  the  light  of  original  agreements 
and  goals. 

My  collective  writing  colloquium,  conceived  as  an  investi- 
gation as  well  as  a  supportive  mechanism  for,  and  affirmation  of, 
popular  educators,  turned  out  to  be  an  action  research  that  taught 
us  a  great  deal  about  the  process  of  action  research  itself,  as 
well  as  the  strategies  of  collective  writing.    In  asking  the  actors 
to  become  authors  we  had  given  primacy  to  participation. 

Thus  I  have  begun  to  consider  participation  so  important  I 
am  asking  these  questions:    Is  participation  the  essence,  or 
heart,  of  action  research?    How  then  can  an  action  research  be 
scientific?    General izable?    Objective?    Since  these  are  serious 
considerations,    I  propose  that  we  develop  an  action  research 
paradigm  that  will  gain  acceptance  and  recognition  by  instructional 
technologists.    Although  it  nay  borrow  liberally  from  experimental 
research  and  ethnographic  approaches,  it  must  have  its  own  charac- 
teristics and  criteria.    This  paradigm  could  serve  a  complementary 
function  to  the  developmental  or  systematic  approach  used  by  some 
of  us  in  research. 
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III    some  Applications  of  Action  Research 

3.1  As  a  technology  for  collecting  data  and  writing  a  script. 

Action  research  may  be  a  useful  vehicle  in  the  area  of 
research  and  development.    A  few  years  ago  I  directed  a  graduate 
study  about  writing  television  scripts  aimed  at  affecting  the 
socio-political  attitudes  of  teenagers.    A  first  script  was 
written  with  the  help  of  adult  experts,  and  the  show  received 
average  ratings.    Then  some  teenagers  animated  by  my  graduate 
student  wrote  a  script  based  on  the  same  ideas  stressed  in  the 
adult-generated. script.    They  participated  simply  and  whole- 
heartedly, producing  a  program  similar  in  plot  but  significantly 
different  in  language,  setting,  impact  and  implications;    it  was 
also  perceived  as  the  more  interesting  program.    My  point  is  this: 
a  participatory  device  need  not  cost  a  great  deal.    What  it  does 
need  is  time  during  which  the  agent  can  become  familiar  with  a 
targeted  milieu  and  win  the  people's  acceptance.    One  further 
advantage  is  the  positive  social  value  of  such  an  endeavor,  which 
flows  from  the  assumption  that  it  is  possible  to  impact  on  dif- 
ficult subjects  such  as  socio-political  attitudes  in  teenagers. 

3.2  As  a  Technology  for  Writing  a  Regional  Research  Proposal 
This  fall  I  was  invited  to  work  with  twenty  doctoral  students 

in  education  from  a  remote  region  500  miles  northwest  of  Montreal. 
My  assignment  was  to  spend  one  day  with  them  and  pick  up  enough 
data  to  formulate  for  them  a  research  project  dealing  With  struc- 
tural development  in  educational  research  aimed  at  ameliorating 
conditions  in  an  underpopulated  area  crippled  by  unemployment. 
During  the  preparatory  week  before  my  trip,  the  participation 
concept  nagged  me.    I  knew  that  at  the  university  we  could  pre- 
pare a  well-structured  proposal  for  them,  trying  to  incorporate 
their  ideas;    but  we  ran  the  risk  of  dampening  or  extinguishing 
the  students'  enthusiasm  and  determination  If  they  did  not  Identify 
with  the  content  and  projected  budget.    My  task  was  to  meet  this 
challenge  in  six  hours. 


523  512 


24 


I  thus  considered  the  students'  strengths*  each  had  developed 
an  individual  project  and,  moreover,  functioned  within  a  four- 
member  group  which  in  the  previous  year  had  written  a  small  group 
proposal  as  a  serious  exercise.    Their  themes  ranged  from  stra- 
tegies in  education,  socio-economic  influences  on  teaching,  and 
the  teaching-learning  situation  to  post-secondary  and  university 
studies  in  education v   Capitalizing  on  the  background  efforts  of 
these  four  subgroups,  I  determined  to  produce  a  unified,  structured 
synthesis  based  on  their  previous  analyses  and  proposals. 

En  route  I  devised  this  strategy s    we  would  play  a  sort  of 
card  game,  dividing  into  two  subgroups,  with  partners  coming  from 
each  of  the  four  nuclear  cells.    We  would  start  with  a  title 
prepared  by  the  staff  of  the  professor  responsible  for  this  off- 
campus  project.    Students  would  discuss  the  following  topics s 
justification  of  their  title  and  theme  objectives;  identification 
of  specific  problems j  methodology  and  research  plans;  and  budgetary 
needs. 

For  our  game  we  needed  only  scissors,  transparent  tape  and 
a  supply  of  white  paper.    Under  the  headings  of  theme,  objectives 
and  problem  areas,  each  group  affixed  on  white  paper  the  general 
statements  expressed  in  earlier  proposals.    They  also  added  new 
reflections.    After  45  minutes  we  held  a  plenary  session  during 
which  progress  and  observations  were  shared.    Thus  we  continued 
until  5  pm,  both  exhausted  and  satisfied.    I  returned  to  Montreal 
with  "rushes",  or  rough  copies,  of  two  proposals  from  which  the 
project  director  made  a  montage.    Our  efforts  proved  worthwhile, 
for  after  the  proposal  was  written,  the  students  sent  a  letter 
congratulating  the  director  that  their  ideas  had  been  respected. 

Although  these  participants  nay  not  receivBj^ir.r^uest^  _. 

allocation,  they  have  expressed  their  real  needs,  and  they  will 
work  to  resolve  them  even  if  dispensors  of  grants  fail  to  give 
them  priority  status  now. 
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I  am  happy  to  report  that  they  have  recently  begun  to 
raise  funds  rather  than  wait  for  the  government  assistance 
that  is  always  tenuous. 

You  may  remark  that  action  research  is  more  like  a  pedagogy 
than  a  research  design.    My  response  is  that  its  model  does  «e* 
blend  into,  or  merge  with,  a  pedagogy.    For  this  reason  action 
research,  although  effective,  is  not  an  easy  strategy  to  promote 
and  perform. 

3.3    As  an  Evaluation  Model 

In  my  research  on  open  pedagogy  I  carried  out  what  I  termed 
anthropopedagogy  (Morin,  1980) .    As  indicated  earlier  in  this 
paper,  student- teacher    cooperation  in  a  university  course  based 
on  an  open  system  was  possible  at  many  stages,  and  students  par- 
ticipated in  revisions  whenever  they  seemed  necessary  and  productive 
This  strategy  is  rather  easy  but  it  can  readily  be  neglected  or 
dismissed  by  professors. 

I  now  believe  that  an  enlarged  anthropopedagogical  model  can 
encompass  the  needs  assessments  of  courses,  appraisal  of  cultural 
elements  in  one's  immediate  society,  and  macroscopic  projections 
on  a  wider  scale.    By  themselves,  however,  these  efforts  are  in- 
sufficient:   such  research  alone  cannot  produce  the  knowledge  we 
need  in  today's  complex  world.    In  our  search  for  significations 
and  models  we  must  borrow  tools  from  anthropology,  since  we  are 
pedagogues  whose  duty  is  to  benefit  and  try  to  transform  the 
younger  members  of  society.    We  seek  not  to  impose  but  enlighten, 
conscienticize  and  teach  students  how  to  operationali  ze . 

CONCLUSION 

I  do  not  wish  to  imply  that  conducting  action  research 
studies  will  assist  a  university  professor  hopeful  of  gaining 
a  hard-earned  promotion.    Quite  the  contrary.  Nevertheless, 
one  who  has  enough  conviction,  tenure,  tenacity,  and  concern 
for  enriching  education  should  consider  working  with  the  action 
research  paradigm  as  a  means  of  bridging  the  gap  between 
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educational  theory  and  practice.    Perhaps  we  can  talk  more 
of ten  about  participatory  research,  as  do  researchers  from 
OISE  (Ontario  Institute  for  Studies  in  Education) ;  maybe  we 
should  invent  more  raultidisciplinary  concepts,  such  as  anthro- 
popedagogy.    At  least  we  can  work  toward  establishing  the 
characteristics  of  action  research,  as  Guba  has  clarified  the 
natCAalistic  paradigm. 

\  Hence  X  expert  to  publish  in  the  near  future  a  list  of 
criteria  concerning  action  research;  they  will  appear  in  a 
French-language  scientific  review.  Some  writers,  like  Lerbet  (1982) 
have  tried  to  reconcile  systems  and  action  research  approaches,  but 
I  believe  that, v despite  these  efforts,  action  research  by  itself 
is  useful  for  the  following  reasons! 

1.  It  forces  us  to  review  the  relationship  between  theory 
and  practice; 

« 

2.  It  allows  us  to  uncover  systems  of  thought  and  action 
through  exploration? 

3.  It  obliges  us  to  review  the  roles  of  the  researcher 

4.  It  transforms  the  instructor,  or  professor,  as  well 
as  the  student,  into  a  communicator  reflecting  on 
real  experience  (Morin,  1979); 

5.  It  can  complement  the  development  of  audiovisual 
material  especially  geared  to  its  specific  audience 
(Kfoury,  1983) ;  and 

6.  Above  all,  it  helps  us  grasp  the  significance  of 
multiple  educational  behaviors  in  a  social -context, 
whether  in  or  out  of  a  formal  school  setting. 

What  makes  action  research  appealing  is  that  it  aims  at 
change  through  reciprocal  transformation  of  action  and  knowledge. 
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The  spontaneous  action  of  an  individual  acquires  strength 
from  a  group  and  provokes  participatory  endeavours  in  others. 

Intuitive  knowledge  favors  enlightened,  involved  dialogue. 
Action  research,  which  necessitates  a^jformal  or  non formal  open 
contract,  implies  cooperative  participation  that  ideally  leads 
to  group  consensus  and  decisions. 

Today's  tendency  toward  conservatism  in  attitudes  as 
characterized  in  governmental  leadership  may  signal  the  need 
for  teachers    —   especially  technologists  —  to  use  resources 
and  teaching  models  that  can  easily  be  neglected.    We  can 
partially  compensate  for  the  diminution  of  certain  freedoms 
and  opportunities  by  promoting  responsibility  in  students.. 
A  major  means  is  to  stress  participation. 
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NOTES 


* 

(1)  Popular  education  refers  to  persons  in  non formal  educa- 
tional .practice  promoting  learning  which  is  linked  to 
real  life  experience  and  needs.    During. a  1981  Quebec 
convention  popular  education  was  defined  as  the  totality 
of  learning  strategies  and  critical  reflections  by  which 
citizens  act  together  toward  a  greater  individual  and 
collective  conscientiousness  regarding  their  life  and 
working  conditions.    Their  aim,  in  the  short, medium  or 
long  term,  is  social,  economic,  cultural  or  political 
transformation  of  a  milieu.    M.  Ouellette,  fiducation 
populaire:    Loisir  et  Culturel,  et  la  politique.  Loisir 
et  Societe,  vol.  4,  no  1,  1981. 

(2)  Groupe  d* education  populaire  en  collaboration  avec  Andr6 
Morin.    L'ecrlture  collective.  Un  mod&le  de  recherche- 
action.  Chicoutimi,  Gafttan  Morin  editeur,  1984. 
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INTRODUCTION 

A  commonly  accepted  theory  believed  to  be  essential  in 
the  learning  process  is  that  knowledge  of  the  correctness  of 
response  be  provided  the  learner  as  quickly  as  possible  to 
enable  him  to  acquire  and  retain  information.     This  theory 
of  immediate  feedback  has  pervaded  instruction  since  early 

0 

studies  in  behavioral  science  where  it  found  greatest 
support. 

A  review  of  current  literature  in  feedback  seems  to 
indicate  that  more  evidence  is  being  generated  which 
essentially  questions  the  validity  of  the  concept  of 
"immediate  feedback**  as  a  general  procedure  and  that  while 
its  effect iveness^n^^rtain  types  of  learning  is  evident, 
it  is  not  always  an  essential  part  of-  the  learning  process. 
In  vi-ew  of  the  controversy  that  appears  to  exist,   this  paper 
will  attempt  to  provide  a  better  understanding  of  feedback 
<FB)   by  assimilating  various- research  data  into  a  philosophy 
that  -iould  have  releVance  to  practitioners  involved  in  the 
teaching/ training /learning  process. 

EIi2i6et<I  What  i3  i£2      *  *  . 

While  feedback  may  literally  be  defined  as  "the  return 
to  a  point  of  origin  of  evaluative  or  corrective  information 
about  an  action  gr  process"  its  etiplogy  appear w  to  be  so 

complex  that  an  accurate  description  of  the  process  and  the 
effect  it  has  on  acquisition  and  retention  of  information 

•  -  ■  ■ 

remains  obscure.     Although  there  is  total  agreement  that  FB 
plays  an  important  part  in  the  learning  process,  there  is 
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still  much  conjecture  regarding  what  the  process  involves, 
the  direction  it  takes,   what  variables  affect  it,  the 
learner's  role,   and  the  terminal  result.  * 

Moreover,  FB  is  thought  to  be  synomynjous  with 
reinforcement  and,  as  such,  has  been  categorized  as 
tangible,  symbolic  ar>d  verbal.     Van  Houten   (1980),  for 
example,  states  that  providing  visual  FB  enhances  the 
acquisition  of  the  most  complex  motor  tasks  and  for  FB  to  be 
effective,   it  must  be  administered  precisely  and  recorded  in 
numerical  terms.     As  described,  however,  visual  FB  is  a  form 
of  reward  intended  to  reinforce  an  acceptable  behavior. 

r 

Basically,   all  FB  originates  from  some  source.  * 

m 

Although  it. is  believed  that  the  source  is  technically  not  a 
part  6i  FP,  the  two  are  often  confounded  because  in  order  to 
undfer^tand  the  effects  of  FB  on  behavior,  the  source  must  be 
identified  and  then,   i ts * inf luence  upon  the  response 
recognized   (Ilgen,  Fisher  &  Taylor,    1979).     When  applied  to 
human  learning,   FB  can  prove  to  be  a  sirnple 
Stimulus-Response  (S-R) ,  Yes-No,  or  a- complex  remedial 
situatipn.     If  viewed  as  a  unitary  var/iable,   its  properties 
may  vary  in  simplicity  and  complexity  along  the  continuum  in 

4 

which  the  process  itself  could  take/ the  form  of  new 
instruction  as* FB  complexity  increases  (Kulhavy,   1977).  As 
such,-FB  may  be  directional  as  well  as  motivational?  while 
it  informs  learners  of  what  behaviors  should  be  accomplished 
it  can  also  provide  i nf or mat i on/ about  the  outcome  associated 
wi  tb/r»ward.   £ct  as  an  incentive  and  serve  as  reward  or 
punishment   (Ilgen,  et  al.    197?) • 
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In  addition,   various  types  and  combinations  of  FB  which 

serve  different  functions  in  conceptual  and  behavioral  tasks 

s 

have  also  been  identified   (Brackbill  &  O'Hara,   1958?  & 
Spence,    1966,    1971 > , 

1.  Right-Wrong:     FB  which  follows  both  correct  and 
incorrect  responses, 

2.  Right-Blank:     FB'  which  follows  correct  responses 
but  does  not  follow  incorrect  responses,  and 

3.  Wrong-Blank:  FB  which  follows  incorrect  responses 
but  does  not  follow  correct  responses  (Barringer  &  Gohlson, 
1979)  . 

Wrong-Bl an k  and  Right-Wrong  combi nations  in  verbal  FB 
is  said  to    produce  equivalent  performance  superior  to  that 
produced  b/  Right-Blank,   however,  Wrong,    it  appears,   is  a 
more  powerful  negative  reinforcer  than  Right  is  a  positive 
reinforcer    (Buss  8c  Buss,    1956).     Blank  is  interpreted  as 
pdsitive  FB  at  the  outset  of  acquisition  in  the  Wrong— Blank 
situation  acquires  a  positive  FB  meaning  in  a  few  trials. 
Blank  in  Right-Blank,   however,  acquires  its  appropriate 
meaning  slowly  and  inconsistently  (Spence,    1966).     It  is 
conjectured  that  the  superiority  of  the  Wrong-Blank 
combination  over  the  Right-Blank  during  acquisition  of 
information  may  be  attributed  to  the  interpretation  of  Blank 
as  signalling  a  correct  response  and/or  that  Blank  acquires 
its  meaning  earlier  when  the  Wrong-Blank  condition  is 
encountered   (Buchwai d ,    1959),     When  no  FD  follows  either  a 
riyht  or  wrong  response,   however,  a  given  hypothesis  is 
maintained  and  the  tendency  to  r  repeat  a  response  on 
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consecutive  trials,  assuming  the  Blank  to  mean  "correct % 
ists   (Levins,  1966). 

AN  ANALYSIS 

Despite  the  many  attempts  at  clarifying  FB  -functions, 
the  total  concept  of  FB  remains  as  controversial  now  as  it. 
was  at  the  time  of  its  inception.     The  Spencer i an  view  that 
Mthe  development  of  a  behavioral  repertoire  in  the 
individual  is  a  mechanical  unintelligent  analog  of  the 
evolution  of  behavior  repertoires  in  different  species"  was 
predominant  at  the  time  the  field  of  behavioral  sciences  was 
beginning  to  take  a  foothold  as  a  science  in  the  lB00's« 
All  behavior  was  readily  interpreted  by  applying  Spencer's 
theory  that  complex  stimuli,   for  example,   were  the  result  of 
chaining  together  of  simple  reflexes,  a  theory  obviously 
based  on  Descartes'  reflex  arc  and  Hobbes*   argument  that  all 
human  action  could  be  understood  in  terms  of  meqhanical 
principles   (Schwartz,    1978).  \ 

The  impetus  to  moving  inquiry  about  human  nature  into 
the  laboratory  and  to  incorporating  the  doctrines  of 
Associationism  into  scientific  psychology  was  initiated  by 
Ebbinghaus  {18*50-1909)  who,  using  himself  as  a  subject, 
developed  a  set  of  empirical   laws  of  association.  Implicit 
was  the  view  that  an  understanding  of  complex  ideas  reflects 
a  past  history  of  association  of  simple  ones..    While 'this 
was  an  important  step  and  a  first  toward  behavior '  theory ,  it 
was  Pavlov   (1B49-1936)   whose  study  o-f  conditional  re-flexes 
and  association  of  ideas  in  the  laboratory  at  the  turn  of 


ERIC 


635  BEST  COPY  AVAILABLE 

  52,1   


Page  5 


the  century  produced  results  that  could  be  seen  and  measured 
that  transformed  the  study  of  th£  laws  of  the  mind  into  the 
stud/  of  human  behavior   (Schwartz ,    1978) • 

Influenced  by  Pavlov's  studies,  Watson,   in  America, 
arrived  at  behavioristic  views,  essentially  that  ail  there 
is  to  human  nature  is  behavior,  from  an  interest  in  animal 
research.   It  was  Watson's  belief  that  the  same  objectives  of 
scientific  observation  could  be  applied  to  the  study  of 
human  behavior  -  that  the  data  collected  by  the  psychologist 
should  be  no  different  from  these  recorded  by  the  physical 
scientist   (Spence,  1956). 

While  the  simple  reflex  arc  theory  could  adequately 
describe  simple  behaviors,   it  did  not  suffice  to  explain 
complex  behavior.      It  was  Thorndike's  study  of  the  behvior 
of  a  caged  cat  that  resulted  in  the  "law  of  effect",  a 
theory  upon  which  operant  conditoning  was  later  to  be  based 
(Saettler,    1968).     Behavior,   in  Thorndike's  view  was  a 
collection  of  simple  reflexes  but  one  that  proposed  action 
with  a  purpose  -  not  the  result  o-f  some  triggered  stimulus, 
rather  the  result  o-f  some  anticipated  goal.     What  primarily 
influences  behavior  is  feedback  -  its  consequences  -  which 
is  automatic.     Acts  that  produce  favorable  consequences  are 
continued  and  those  with  unfavorable  consequences  are 
terminated    (Schwartz,    1978;   Spence,  1956). 

The  impact  of  this  conception  of  feedback  on  American 
education  cannot  be  overly  exaggerated.  Skinner, 
establishing  his  methods  on  earlier  studies  by  Thorndike  and 
an  the  results  gathered  from  human  and  animal  studies,  was 
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convinced  that  all   human  behavior  is  shaped  by  the 
reinforcement  of  correct  behavior,  .clearly     an  endorsement 
of  the  S-R  theory. 

FyRTHER  ANALYZED 

While  there  are  still  those  whose  propensities  are  that 
FB  may  be  encumbered  within  the  S-R  theory,  research 

continues  to  produce. ..evidence  that  FB  is  considerably  more  

complex  than  heretofor  thought  to  be.     Annett   (1969),,  for 
example,  analyzes  FB  as  action  FB  and  learning  FB.  While 
action  FB  occurs  during  a  response  and  may  affect  the 
response  while  it  is  happening,   learning  FB  occurs  after  a 
response  delayed  long  eneugh  not  to  be  affected  by  the 
response. 

In  effect,   action  FB  as  it  is  described  may  be  viewed 
as  a  linear  S-R  condition  while  learning  FB  may  be 
identified  as  a  closed  loop  best  compared  with  Weiner"s 
servo-mechanism  model  where  FB  can  be  graphically 
represented  as  a  function  controlled  by  the  consequences  of 
its  own  behavior   (Annett,   1969).     Like  a  servo-mechanism  it 
has  a  source;   a  transducer,  a  device  which  measures  the 
input  and  output  of  the  machine  and  a  FB  loop  whith 
translates  the  output  measure  into  a  signal  which  can 
control   the  input.     Such  a  FB  controlled  system  has  the 
property  of  maintaining  a  set  level  of  outputs  regardless  of 
fluctuations  in  the  "load"  imposed  by  the  environment. 
E /i dence  of  these  characteristics  may  be  recognized  in  a 
simple  discrimination  act  of  picking  up  a  lead  weight  and  a 
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ball  -  not  as  much  effort  is  expended  into/  lifting  the  light 

weight  as  the  heavier  lead  weights     The  tendency  of  the 

system  to  maintain  equilibrium  in  the  internal  environment 

demonstrates  the  existence  of  the  servo-control  system.  An 

interruption  of  the  system  causes  a  disruption  in  the 

equilibrium  of  the  system. 

While  Annett's  <1969)  analysis  may  represent  a 

breakthrough  in  a  better  understanding  of  FB,  accumulating 

evidence  indicates  that  stimuli  depend  on  responses 

according  to  the  current  organization  of  the  entire  body  in 

which  the  nervous  system  resides,   that  all  behavior  involves 

FB  effects   (Powers,    1973).     Literally,  all  FB  is  behavior. 

When  a  certain  behavior  is  exhibited,   it  is  the  result  of  FB 

effects  of  the  individual's  output.  Presumably  behavior  is  ~~ 

controlled  perception,   not  simply  a  reaction  to  some 

stimulus.   Where  goals  and  purposes  for  behavior  could  not 

have  been  accounted  for  previously,  they  can  now  be  viewed 

as  a  part  of  the  FB  process  and,  moreover,  explain  why 

different  variables  produce  the  same  results*.     An  animal, 

trained  to  walk  a  certain  pattern  seems  to  -follow  a 

« 

consistent  pattern  with  each  trial,   yet  upon  close 
examination  the  movements  are  not  exactly  the  same.  When 
the  cage  is  tipped,   the  animal  continues  to  walk  the  learned 
pattern,   compensating  for  the  tipped  cage.     The  animal 
change  its  behavior  though  the  pattern  remains  unchanged. 

Powers   <1973>,    in  explaining  this  phenomenon,  states 
th*t.  all  behavior  is  goal -or  i  ented  at  all  times  around  the 
control  of  certain  quantities  in  respect  to  specific 
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referent  conditions-     When  a  learner  acts,   it"  is  in" 
counteraction  to  the  effects  of  a  disturbance  on  certain 
controlled  quantities.     Only  this  difference  betweert  the 
quantities  and  its  reference  condition  produces  the 
response/behavior.     It  is  not  the  situation  that  causes  the 
response?   it  is  how  the  subject  or  learner  perceives  the 
situation. 

Controlled  perception  however  does  not  mean  the  absence 
of  control  by  the  learner?  on  the  contrary  there  is  control 
when  a  new  reference  condition  arises  but  each  action  occurs 
according  to  a  hierarchy  of  controlled  quantities  where  one 
controlled  quantity  is  controlled  by  means  of  changing  the 
reference  level  with  respect  to  which  a  second  quantity  is 
controlled  -  the  top  of  the  hierarchy  answering  the  question 
11  Why?"  and  going  down  to  the  second  level   MHow?M.  Fast 
enough  variations  in  the  controlled  quanti tites,  however, 
cannot  all  be  sorted  out,   therefore  they  became  noise  with 
respect  to  behavior. 

IMMEDIATE  FEEDBACK 

As  significant  as  these  various  functions  of  FB  have 
been  found  to  be  in  the  acquisition  and  retention  of 
information,   the  immediacy  with  which  FB  is  presented  has 
long  been  believed  to  be  essential    (Skinner,   1954).  Based 
larqely  on  direct  application  of  Thorndike's  Law  of  Effect 
and  Ski  nner *  s  operant  condi  toni  ng  assumpti  ons,  the  practice 
of  presenting  immediate  FB  to  reinforce  the  correct  or 
deai red  response/behavior  immediately  and  frequently  to 
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ensure  the  establishment  of  that  response/behavior  was 
hypothesised  as  the  result  of  repeated  experiments  both  in 
the  laboratory  and  out.     To  behaviorists,   the  supportive 
data  amassed  was  evidence  that  despite  the  obvious 
differences  between  small  animals  and  humans,  all  organisms 
show  similar  learning  process  properties.     It  was  generally 
believed  that  only  by  manipulating  reinforcement  could  the 
behavior  of  the  individual  organism  be  brought  under  control 
(Skinner,   1954) • 

Although  pioneering  efforts  in  the  application  of  the 
reinforcement  theory  began  with  Pressey's  (Pressfyp  1950) 
punchboard,   a  device  used  in  giving  the  learner  immediate 
knowledge  of  response  in  sel f -instruction  and 
sel  f -correction*,   it  was  the  meteoric  popularity  of  Skinner's 
teaching  machine  and  programmed  instruction  efforts  in  the 
60's  that  seemed  to.  verify  the  prediction  by  behaviorists 
that  these  techniques  would  revolutionise  education 
(Skinner,    i960) . 

Despite  the  flurry  of  activity  in  programmed 
instruction  and  the  massive  amount  of  data  accumulated  by 
behaviorists  as  to  their  successes,   the  use  of  teaching 
machines  and  programmed  i nstruct i on  gradual 1 y  di mi ni shed . 
Although  its  demise  may  be  due  to  teacher  resistance  in  more 
than  a  few  cases,   its  disfavor  might  also  be  due  to  the 
inapplicability  of  the  Skinnerian  theory  to  all  learning 
situations  as  had  been  claimed  or  assumed. 

Evidence  of  the  effectiveness  of  another  type  of  FB, 
Delayed  Feedback   (DFB)   was  concurrently  being  produced  in 
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direct  contradiction  of  the  theory  of  immediate  FB. 

DgLA?ED  ItJFORMATlQy  EE£E§ACK  IBIEi 

Probably  the  most  important  and  subsequently  the  most 
discussed  and  examined  aspect  of  verbal  feedback  has  been  in 
the  effects  of  a  phenomenpn  most  often  referred  to  as 
delayed-inf ormation  feedback   (DIF),  that  is,  delaying  the 
presentation  of  feedback  for  a  period  of  time.     Studies  in 
DIF  describe  the  effect  of  delay  of  information  on  retention 
to  be  dependent  on  the  type  of  information  FB,  the  length-  of 
delay  and  the  type  of  material  to  be  learned.     Delay  has 
been  shown  to  improve  retention  of  meaningful,  not  nonsense, 
material  when  the  information  feedback  consists  of  the 
entire  item  with  the  correct  answer   (Sturges  &  Crawford, 
1964).     Generally,  no  significant  difference  has  been  shown 
to  exist  in  retention  between  immediate  information  FB  and 
DIF  when  the  information  FB  of  meaningful  material   is  only  a 
cue  suggesting  the  correct  answer  (Brackbill,  Bravos  & 
Starr,   1962?  Sturges,   Sarafino  &  Donaldson,   1968?  Sassenrath 
and  Yonge,  1968). 

Although  the  effects  of  DIF  have  been  widely 
researched,  assumptions  of  its  etiology  reveal  as  much 
speculation  and  disparity  among  researchers  now  as  ever 
before.   While  it  can  be  conjectured  that  DIF  improves  later 
performance  as  the  result  of  covert,   symbolic  activity  which 
occurs  between  the  initial  presentation  and  FB  (Sturges  & 
Crawford,   1964) J   it  is  also  theorised  that  subjects  use 
language  to  relate  delayed  FB  to  earlier  learning 
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(Sassenrath  and  Yonge,    1968) .     The  use  of  response-produced,  \ 
external  or  verbal  cues  to  help  mediate  the  delay  period  or  \ 
language  to  related  delayed  FB  to  earlier  learning  are 
believed  to  be  essential   in  the  regulation  of  one's  behavior 
with  respect  to  remembering  past  events  and  anticipating 
future  events  (Brackbi 1 1  &  Kappy,  1962). 

On  the  basis  of  studies  with  human  subjects,  Kulhavy 
and  Anderson   (1972)  theorise  that  incorrect  responses  are 
forgotten  over  a  period  of  time  and  that  this  forgetting 
tends  to  facilitate  the  learning  of  correct  responses 
whereas  in  immediate  FB,  there  is  proactive  interference 
from  committed  incorrect  responses.     The  delay  period  allows 
a  person  to  forget  the  wrong  answer  which  acts  as 
interference  and  facilitates  the  acquisition  of  the  correct 
response.  •    That  this  Interf erence-Perseveration  occurs  is 
contingent  upon  the  learner  and  his  ability  to  comprehend 
the  material  being  tested   (Kulhavy,    1977).     If  the  material 
is  too  difficult  and  unfamiliar,  and  the  student  attempts 
answering  items  by  guessing,  then  the  value  of  FB  becomea  a 
moot  point. 

The  theory  holds  particularly  true  when  test  items,  for 
example,  are  of  the  multiple-choice  type  where  the  stems  of 
the  items  are  identical  but  the  results  are  antagonistic. 
Delay-Retention-Effect   (DRE)  provides  the  learntar  with 
information  about  the  accuracy  of  what  has  already  been 
learned  and  provides  an  avenue  by  which  wrong  answers  may  be 
corrected   (Kulhavy,    1977;   Surber  *«  Anderson,    1973) . 
Positive  feedback  however,   is  not  affected  by  the 
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interference  when  given  immediately  after  the  response  or 
later,   so  the  delay  is  less  of  ah  issue  (Ilgen,  et  al . , 

197?) . 

In  comparison  with  the  substantial  amount  of  data 
supporting  immediate  FB  as  an  effective  instructional 
technique,  scant  data  on  which  to  develop  general izable 
assumptions  about  delayed  FB  exist.     Although  there  is 
growing  evidence  that  DRE  is  more  effective  under  certain 
circumstances  than  immediate  FB,  the  wide  acceptance  of  it 
has  overshadowed  attempts  to  reexamine  delayed  FB  in  light 
of  new  evidence.     Additionally,   there  are  studies  which  show 
the  ineffectiveness  or  the  Mno-di f f erence"  effect  of 
Del ayed-Retention-Ef feet   (DRE>  as  described  in  a  review  of 
14  studies  by  Sassenrath  and  Yonge  (196B)  which  show  only 
two  that  favor  DIF  to  be  significantly  effective  in  learning 
efficiency  and  eleven  which  show  no  significant  difference. 
Verbal,   concept  or  discrimination  learning  is  shown  not 
totally  affected  by  DIF,  but  is  affected  by  the  interaction 
of  other  variables:     size  of  population  sampled   (Beck  and 
Lindsey,   1979),  composition  of  population  sampled  (Krumboltz 
&  Weisman,    1962),   lack  of  control  in  test  administration 
(Sullivan,   Schutz  and  Baker,   1967),  and  the  amouilt  of  cueing 
supplied   (Sturges,    1969,   1972S  Sassenrath,   1969,  1975; 
Smarts  &  Sassenrath,  1972). 

QlbER  VARIABLE^  IHAT  AFFECT  El 

To  add  to  the  complex i ties  obviously  inherent  in  the  FB 
process,   it  is  proposed  that  FB  may  also  be  a  function  of 
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the  initial   learning  state,  that  individual  differences 

t 

among  learners  must  be  considered- before  any  judgement  can 
be  made  about  what  may  be  causing  specific  behaviors  and  why 
(Newman,  Williajns  and  Hiller,   1974),   Besides  the  strong 
relationship  found  to  exist  between  sel f -concept  and 

i 

performance  (Boersma,  Chapman  8c  Battle,    1979^   there  is 
indication  that  students  with  low  nptitude  stores  received 
the  most  benefit  from  delayed  knowledge  of  results  and  that 
students  with  higher  scores  show  little  difference  in 
advantage  of  one  treatment  over  the  other.     Joseph  and 
Maguire  (1982)   propose  that  individual  differjenc.es  among 
students  must  be  considered  before  any  judgempnt  can  be  made 
about  what  may  be  causing  a  certain  behavior  jand  why. 

Even  as  studies  attempt  to  clarify  these,  issues,  other 

\ 

interacting  variables     appear  to  be  actively  fcvolved  in  the 

I 

process.     Reinforcement  schedules,   autonomy  n^ed  and 
achievement  studied  in  a  programmed  course  shewed  that  with 


college  students,  highest  scores  were  recorded  of 
above-average  aptitude  students  with  no  reinforcement  and 
the  lowest  with  continuous  reinforcement,  however  on  the 
criterion  test,  high  autonomy-need  students jscored  lower. 
It  could  be  concluded  that  students  who  have  high  autonomy 
needs,  being  high  achievers  also  are  frustrated  by  the 
expectations  and  requirements  of  the  instrwciion  and  the  low 
autonomy -need  group  felt  more  comfortable pecause  they  did 
not:  feel  the  need  to  achieve.       Similarly!   students  with 
higher   academic  achievement  have  been  fodnd  to  have  greater 
ability  to  give  internal  feedback   (self -/feedback)  where  lesS 
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dependence  on  external  feedback  is  exhibited  (Lublin,  1965). 

Locus  of  control,  another -variable  related  to  academic 
achievement,  has  been  found  in  some  studies  to  interact  with 
FB.     Statistically  significant  correlation  between  locus  of 
control  and  internal  FB  and  external  FB  variables  when 
academic  achievement  is  used  as  a  dependent  variable  has 
been  found   (Maqsud,    1983;  Baron  &  Ganz ,    1972).     While  the 
internal  aspect  of  FB  has  its  interacting  influences,  so 
does  the  external.     There  appears  to  be  a  link  between  FB 
stimulus  and  the  perceived  FB  with  the  stability  of  that 
link  dependent  on  the  characteristics  of  the  source,  the  _ 
stimulus  and  the  learner  -  the  more  positive,  the  more 
powerful   and  credible  the  source,   the  more  accurately  is  the 
FB  perceived.     Peer  influence;  teacher  power,  expertise, 
status  and'  influence,   and  status  in  the  environment  all 
affect  the  FB  process   (Baron,  Cowan,  Ganz  &  McDonald,  1974; 

Root  St  Gall,  1981). 

Additionally,  the  effect  of  socio-economic  status,  race 

s 

of  learner  and  experimenter  and  praise,  criticism  and 
silence  as  FB  on  performance  was  studied.     While  no 
differences  were  noted  with  the  type  of  FB„  significant 
interactions  were  found   (Baron  et  al . ,  1974). 

impuxgajxqb§ 

Without  doubt,  prima  facie  evidence  dictates  that 
application  of  FB  not  be  attempted  indiscriminately  nor 
unpremeditatedly.  Yet  textbooks  freely  list  "immediate 
feedback"  as  one  of  the  essential  principles  in  teaching. 
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The  texts  ignore  al together  any  other  type  or  combination  of 
FB  or  the  consequences  of  timing  of  FB.     As  a  result, 
teachers  have"  for  years  striven  to  return  graded  test  papers 
as  quickly  as  possible,  believing  it  to  be  an  effective 
teaching  technique. 

□f  yet  greater  concern  is  the  current  prolific 
application  of  the  principles  which  underlie  immediate 
feedback  in  the  design  and  development  of  computer-assisted 
instruction   <CAI>.  Despite  the  numerous  studies  that 
indicate  individualized  instruction  to  be  a  very  complex 
.methodology  which  requires  the  use  of  reliable  and  valid 
teaching  material  besides  an  understanding  of  individual 
learning  processes,   much  of  the  computer  software  currently 
available  are  samples  of  programmed  instruction  as  it 
existed  ten  years  ago. 

A  review  of  the  literature  on. feedback  will  also 
describe  other  studies  of  extreme  relevancy  to  those 
involved  in  the  instructional  process.     As  often  as  it  is 
suggested,  tangible  FB,  or  material  reward,  may,  not  provide 
for  rapid  acquisition  of  information   <Spence,   19711  Spence  * 

*  * 

Segner,   1967)  and  sometimes  produces  the  poorest  performance 
(Mims  Sc  Gohlson,   1977).     There  is  ample  evidence  that 
tangible  FB  such  as  candy,  toys  and  money  can  be  effectively 
used  to  control  human  behavior   (Anderson,   1967) ,  however 
there  has  been  a  ^reluctance  to  employ  this  method  because 
educators  would  prefer  to  use  "intrinsic  reinforcement " . 
The  objection  to  "extrinsic  reinforcement"  is  the  inherent 
fear  that  the  student  will  become  too  dependent  on  receiving 
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such  FB  and  be  unable  to  perform  without  it.      In  addition, 
tangi blie" FB  may  distract  from  tpe*  relevant  stimuli  and 
produce  a  deficit  in  performance   (Mims  &  GohlsonjT  1977, 


Tangible  rewards  seenl  to  be  especially  important  to 
disadvantaged,  retarded;,  disturbed,  or  very  young  children 
(Lysakowski  &  Walbsrg,    1981).     Although  tangible  rewards  are 
objectionable  to  many  educators,  they  have  been  used  \t 
effectively  on  a  variety  of  students  ranging  from  high 
school  dropouts  to  grade  school  children  with  academic 
achievement  problems  and,   in  addition,  have  been 
successfully  employed  in  a  number  of  settings,  from  the 
psychiatric  ward  to  the  classroom   (Anderson, . 1967)  to 
industry   (Ilgen,   et  al .  ,    1979)      In  certain  situations,  ths 
ex'rinsic  reward  is  reauired  in  a  learning  task  tc  maintain 
control  a*  instructional  materials  over  student  responses. 
It  is  said  that  regardless  of  the  quality  of  the  material, 
unless  the  student  is  given  an  incentive,  he  will  not  leur 
the  lesson  well.     Yet,  as  described  earlier,   the  effect  of 
extrinsic  rewards  are  highly  contingent  upon  the  individual 

*  # 

and  environmental  variables. 

Regardless  of  intent,   the  accommodation  for  individual 
differences  in  all  children  would  prove  to  be  a  difficult, 
if  not  impossible  task  to  undertake.     Yet,   the  fact  remains 
thc*t  for  FB  to  be  most  effective,    individual  differences 
must  be  attended  to.     Forness   (1973)   proposes  an  heirarchy 
of  FB  and/or  reinforcement  for  different  individual   types  as 
an  initial   step  in  the  determination  of  appropriate 
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administration  of  FB: 

1.  The  competent  ones  who  -"learn  -for  the  reward  of 

mastery. 

2.  Those  who  require  positive  FB  about  the  correctness 
o-f  a  response. 

3.  Those  who  need  social  approval. 

4.  Those  who  react  contingent  upon  the  nature  o-f  the 
activity. 

5.  Those  who  need  token  FB  (could  be  symbolic 
rein-f  orcement ) . 

6.  Those  who  require  tangibles  such  as  toys,  money, 

etc. 

7.  Those  who  need  edible  rewards. 

Perhaps  the  most  significant  application  of  immediate 
FB  could  be  found  in  the  development  of  programmed 
instruction  where  immediate  responses  were  required  to  small 
frames  of   instruction.     Although  the  effectiveness  and 
efficiency  of  the  immediate  response  is  still  believed  to  be 

true,  several  studies  show  that  performance  may  be  better 

\' 

with  np  knowledge  of  response  (Lublin,   1965).     It  is 

ii 

hypothesised  that  when  no  knowledge  of  the  correct  response 
is  giv^n,  each  frame  demanded  more  attention  from  the 
students  and  required  them  to  study  each  frame  more 
carefully.     The  results  of  Lublin's  study  lend  support  to 
the  idea  that  programmed  instruction  should  be  written  in 
large  steps  rather  than  small  ones   (Krumboltz,  1964). 
According  to  Keller   (1968)   instruction  should  be  in  j 
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principal  steps  and  not  simply  "frames"  in  a  "set". 
CONCLUSION 

Clearly,  FB  is  a  complex  process  which  can  nd  longer  be 

* 

adequately  described  within  the  parameters  of  the 
traditionally  held  S-R  paradigm,  nor  can  it  be  said  that 
"immediate"  FB  must  be  given,  or  that  delayed  FB  is  more 
effective  in  learning.     Rather,  FB  in  all  its  complexity 
must  be  viewed  as  knowledge  of  response  affected  by 
variables  within  the  individual  and  in  the  environment. 
Although  the  Skinnerian  theory  or  operant  conditioning 
serves  to  enhance  some  types  of  learning,   it  has  been  found 
to  be  ineffective  in  others.     A  strict  adherence  to  one 
concept,   as  is  most  unfortunately  recommended  in  many 
textbooks  on  instructional  procedures,   ignores  the  existence 
of  scientific  evidence  at  the  expense  of  the  learner. 
The  developmental  study  of  FB  indicates  disagreement  not  on 
the  external  mani f estati on&  of  the  theories  that  have  been 
expounded  by  Descrates,  .Thorhdike,  Watson  or  Skinner  but  in 

their  teleology.     Each  theory  appears  to  have  used  the 

\ 

latter  as  a  foundation  upon  which  Xo  build  a  better  and  more 
comprehensive  theory.     There  is  great  similarity  between 
Thorndike's  "law  of  effect"  and  Power's  theory  of 
goal-oriented  behavior,  for  example.       The  influence  of 
behaviorism  and  the  practice  of  immediate  FB  have  so 
pervaded  instruction  over  the  past  60  years  that  much  of 
what  have  been  developed  toward  the  improvement  of 
instruction  indicate  a  total  reliance  on  the  guidance  bf 
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immediate  -feedback.     While  much  data  can  be  provided  in 
proving  its  success,  scant  data  can  be  -found  in  support  of 
other  methods. 

Feedback  will  remain  an  enigma  until  research  is 
conducted  comparing  the  different  methods  of  FB  on  the  same 
students  and  the  same  subject  matter.     Until  then,  educators 
must  rely  on  the  Sparse  current  studies  on  FB  to  use  it 
effectively  and  efficiently  in  instruction. 
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ABSTRACT 


The  purpose  of  this  study  was  to  Investigate  the  relative  effectiveness 
of  verbal  and  visual  augmentation  of  rate-modified  speech  1n  the  presentation 
of  technical  material.'  Research  has  shown  that  the  complexity  of  the  stlmu-  ' 
lus  material  has  a  direct  effect  on  achievement  (or  comprehension)  at  com- 
pressed rates.   It  may  be  possible  to  supplement, the  compressed  rates  of 
speed  so  that  results  approaching  or  surpassing  normal  rates  can  be  achieved. 
The  addition  of  text  or  visuals  to  accompany  an  aural  presentation  may 
provide  the  additional  Information  necessary  to  allow  the  faster  compression 
rates  to  be  as  effective  as  a  normal  rate.  Research  also  suggests  that  focus 
should  be  directed  to  the  specific  learning  task  being  presented.  This 
Implies  that  specific  learning  tasks,  presented  via  auditory  channels,  be 
evaluated  using  Instruments  designed  to  measure  achievement  of  each  of  those 
specific  tasks.   The  population  consisted  of  40  graduate  students.'  Materials 
used  consisted  of  normal  and  compressed  versions  of  the  Dwyer  Heart  script, 
printed  copies  of  the  script,  black  and  white  simple  Tine  drawings  and  the 
related  evaluation  Instruments.   Subjects  were  assigned  to  one  of  four  treat- 
ment groups;  normal  version/no  augmentation,  compressed  version/no  augmen- 
tatlon,  compressed  version/text  augmentation,  compressed  version/visual  .x 
augmentation.  After  listening  to  their  respective  treatments,  students  were 

i 

administered  the  four  achievement  tests.  Analysis  of  variance  procedures 
were  applied  to  the  data. 
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Purpose 

The  purpose  of  this  study  was  to  Investigate  the  relative  Instructional 
effectiveness  of  rate-modified  speech  used  alone  and  when  augmented  with 
e1ther'v1sua1  or  verbal  materials  In  the  learning  of  technical  material. 
Considerable -research  has  Investigated  the  comprehension  of  verbal  material | 
presented  by  means  of  compressed  or  rate-modified  speech  (Duker,  1974).  A 
comprehensive  review  of  this  research  (Olson  and  Berry,  1982)  Indicated, 
however,  that  limited  research  has  focused  on  the  use  of  rate-modified  speech 
with  technical  materials  and  the  effect  of  verbal  and  visual  augmentation 
upon  comprehension  of  compressed  audio  messages.  Additional  research  would 
provide:   (1J  Information  concerning  the  use  of  rate-modified  speech  with 
material  that  1s  technical  1n  nature,  (2)  a  determination  of  how  specific 
learning  tasks,  are  affected  by  using  rate-modified  speech,  and  (3)  an 
explanation  of  the  relative  effectiveness  of  verbal  and  visual,  augmentation 
to  rate-modified  messages. 

Rate-Modified  Speech 

For  many  years  the  rapid  learning  of  large  amounts  of  Information  has 
been  a  continuing  educational  concern.    In  more  recent  years  this  persistence 
has  Intensified.   Duker  (1974)  Identified  the  problem  that 'large  amounts  of 
Information  Impose  upon  the  learner.   He  noted  that  today's  society  has 
become  more  dependent  upon  communication,  necessitating  the  listener  to  , 
accommodate  a  mass  of  knowledge  that  1s  growing  In  geometric  proportions. 
The  proliferation  of  journals,  newspapers,  books  and  other  types  of  media 
has  evolved  to  a  point  where  an  Individual  can  no 'longer  remain  current  at 
the  same  pace  with  whlcn  new  developments  occur.   The  problem  that  Duker 
Identified  10  years  ago  1s  even  more  apparent  today.  With  the  new  technologies 


erJc  561  .548 


that  the  microprocessor  affords  comes  an  era  where  the  learner  1s  Inundated 
with  material  to  read  or  merely  peruse  at  a  pace  that  becomes  more  rapid 
every  day.   The  technology  that  permits  society's  advancements  and  develop- 
ments has  also  contributed  to  a  knowledge  base  that  has  become  so  enormously 
unwieldy  that  the  learner  cannot  keep  pace. 

This  imperative  1s  compounded  by  the  fact  that  Individuals  learn  at 
different  rates.   Since  time  spent  In  instruction  1s  an  Important  factor 
1n  maximizing  Instructional  efficiency,  It  1s  of  vital  Importance  to  Identify 
a  means  by  which  the  learner  can  be  aided  1n  Increasing  the  effectiveness  of 
the  tine  spent  1n  learning. 

Today's  technology  has  contributed  to  the  current  state  of  affairs 
concerning  the  infrnnatlon  explosion  that  plagues  the  learner.  Current 
technology,  however,  also  offers  a  number  of  viable  solutions  within  Its 
own  parameters.   One  means  this  new  technology  has  provided  Is  that  of 
altering  recorded  speech  so  that  the  Instructor  or  student  may  adjust  the 
rate  of  presentation  to  suit  his  needs.   This  technique  1s  termed  rate- 
modified  speech  or  more  popularly  refarred  to  as  "compressed  speech" 
(Sllverstone,  1974). 

Sllverstone  described  this  method  of  rate  modification  as  the 
"...reproduction  of  an  original  recording  1n  which  the  word-per-m1nute 
ratio  1s  changed  to  a  slower  or  faster  rate  of  speech  without  eliminating 
the  pitch  0-  natural  quality  of  the  voice." 

Considerable  research  has  focused  on  rate-modified  speech  and  Its  use 
1n  Increasing  learning  efficiency  through  the  auditory  mode.  These 
investigations  have  contributed  to  an  enormous  body  of  knowledge  that  spans 
over  five  decades  (Duker,  1974;  Olson  and  Berry,  1982;  Orr,  1968). 
Generally,  compressed  speech  has  been  shown  to  bi  as  efficient  as  normal 
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rates  of  speech.  The  average  conversational  rate  at  which  a  person  speaks 
1s  tn  the  range  of  100  to  150  words  per  minute  (Nichols  and  Stevens,  1957; 
Silver s tone,  1974).  A  listener  can  comprehend  and  process  Information  at 
a  rate  up  to  or  approximating  400  words  per  minute  (Silver stone,  1974). 
This  creates  a  speaking/1 1sten1ng  discrepancy  since  a  listener  can  compre- 
hend spoken  material  up  to  four  times  faster  than  the  speaker  can  send  the 

/ 

message.   The  result  Is  a  listener  who  becomes  bored  or  whose  attention 
begins  to  wander. 

Substantial  research  has  focused  on  both  intelligibility  and  comprehen- 
sion of  rate-modified  speech.    Intelligibility  refers  to  the  extent  that 
one  1s  able  to  repeat  Information  which  was  presented  or  to  discriminate 
what  one  has  heard.   Comprehension  refers  to  the  ability  to  extract 
knowledge  or  Information  from  what  one  has  heard,  usually  by  completing 
an  objective  test.   Generally,  no  significant  differences  have  been  found 
between  normal  and  compressed  modes  in  terms  of  comprehension  or  Intelli- 
gibility at  rates  up  to  250  words-per-mlnute  (Foulke,  1966,  1967).  Foulke 
(1971)  suggested  that  this  Implies  a  working,  auditory  processing  limit 
of  approximately  275  woras-per-m1nute. 

Foulke  (1968a)  reported  that,  with  word  rates  ranging  from  125  to  400 
words  per  minute,  comprehension  was  found  to  be  adequate  until  the  word 
rate  exceeded  250  words-per-mlnute.  As  the  word  rate  rose  higher,  the 
level  of  comprehension  decreases  1n  an  Inverse  proportion.   Foulke  hypo- 
thesized that  adequate  processing  time  1s  needed  for  perception  of  words 
1n  order; for  comprehension  to  occur.    Zf  processing  time  Is  reduced,  a 
decrease  1n  comprehension  results.  Lost  processing  time  was  Indicated  to 
be  a  contributing  factor  1n  the  level  of  comprehension.   Hausfeld  (1981) 
presented  strong  evidence  for  a  working  memory  processing  limit  of  approx- 
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^nately  275  words -per -minute.  / 

Foul ke  (1968b)  Indicated  that  in  measuring  comprehension,  there  are  two 
groups  of  factors  which  must  be  taken  Into  consideration:    (1)  organism 1c 
features,  and  (2)  characteristics  of  the  signal.   Organ 1sm1c  factors  Include 
age,  sex,  Intelligence  and  previous  experience  with  the  subject.  Character- 
istics of  the  signal  are  concerned  with  word  rate,  method  of  compression 
and  rate  of  occurrence  of  the  speech  sounds. 

Relatively  few  researchers  have  devoted  adequate  attention  to  the  char- 
acteristics of  the  message  Itself.   This  third  area  for  consideration  includes 
readability,  complexity  of  Information  and  the  relative  density  of  Ideas  or 
concepts. 

Substantial  research  has  focused  on  both  Intelligibility  and  comprehen- 
sion of  time-compressed  speech.   Generally  no  significant  differences  have 
been  found  between  normal  and  compressed  modes  in  terms  of  comprehension  or 
Intelligibility  at  rates  up  to  250  words-per-m1nute  (Foulke,  1966,  1967). 

Research  has  been  less  conclusive,  however,  1n  determining  the  effec- 
tiveness of  utilizing  compressed  materials  when  the  content  1s  of  a  more 
complex  or  technical  nature.   The  earlier  research  in  rate-modified  speech 
has  generally  concluded  that  faster  rates  were  equal  to  or  more  effective 
than  slower  rates.   Subsequent  research,  however,  raised  the  issue  of  using 
material  that  was  of  a  more  complex,  technical  nature,  and  challenged  the 
former  conclusion  that  faster  rates  were  superior. 

One  methodological  problem  Inherent  1n  much  of  this  research  work  is 
that  they  used  a  variety  of  recorded  messages  which  did  not  take  Into 
account  the  specific  learning  objectives  or  tasks  and  th«  complexity  of 
Information.   The  efficiency  Index  of  Fairbanks  used  1n  past  studies 
assumed  that  all  passages  used  were  of  equal  difficulty  and  Importance. 
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Factors  such  as  the  length  of  the  stimulus  materials*  density  of  ideas, 
Hems  learned  and  not  learned,  and  the  difficulty  of  Items  learned  and  not 
learned,  were  not  considered  (Adelson,  197S).   Other  research  suggests 
that  regardless  of  the  speaking  rate  utilized,  Increasing  the  difficulty 
of  the  stimulus  material  results  in  a  reduction  of  the  amount  of  material 
that  1s  comprehended  (Splcker,  1963).   Grammatical  complexity  has  also 
been  shown  to  have  an  Inverse  effect  on  the  amount  of  comprehension  of 
compressed  material  (Reld,  1968).   The  type  of  Information  used  has  an 
effect  on  comprehension  and  may  also  represent  related  but  different 
aspects  of  listening  comprehension. 

It  has  been  established  that  material  containing  different  types  of 
Information  such  as  drawing  Inferences,  formulating  ideas  and  dealing 
with  facts  yields  different  results  1n  comprehension  of  compressed 
materials  (Rossi ter,  1971).   These  finds  seem  to  Indicate  that  material 
that  1s  more  complex  or  technical  in  Its  content  would  be  more  adversely 
affected  by  higher  rates  of  compression. 

There  exists  from  these  research  efforts  substantial  evidence  that 
rate-modified  speech  1s  a  valuable  learning  tool.   The  effectiveness  of 
this  learning  tool,  however,  may  be  affected  by  the  addition  of  certain 
supplemental  Information  1n  an  effort  to  provide  additional  or  redundant 
information  via  another  channel.   Since  it  has  been  established  that  rate- 
modified  speech  has  a  positive  effect  on  comprehension  of  compressed 
materials,  1t  1s  conceivable  that  the  addition  of  text  or  visual  augmenta- 

* 

t1 on  would  further  Increase  this  effect. 

The  use  of  text  and  visual  materials  to  augment  rate-modified  messages 
has  been  explored  1n  past  research.   Generally,  their  use  with  materials 
of  varying  compression  rates  has  been  found  to  be  of  significant  educational 

+ 
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importance.   The  redundant  information  provided  by  the  printed  text  and 
the  additional  cues  provided  by  visuals  has  aided  1n  the  processing  of  the 
compressed  material.   It  is  of  Interest  to  determine  1f  these  two  types  of 
augmentation  (text  and  visuals)  provide  additional  support  to  compressed 
material  that  Is  of  a  technical  nature.  The  additional  of  visual  augmen- 
tation to  accompany  an  aural  presentation  amy  provide  the  additional 
Information  necessary  to  allow  the  faster  compression  rates  to  be  as 
effective  as  a  normal  rate.  The  use  of  printed  text  may  provide  the 
redundancy  needed  to  comprehend  the  spoken  material.   Similarly,  the  use 
of  Illustrations  may  provide  enough  additional  Information  for  the  learner 
to  organize  or  restructure  the  material. 

It  would  appear  that  the  visual  augmentation  of  compressed  auditory 
material  may  Improve  comprehension.   If  such  a  difference  does  occur,  1t 
1s  necessary  to  Identify  which  type  of  visual  augmentation,  1f  any,  1s 
more  effective  1n  providing  for  this  difference.   No  research  to  date  has 
investigated  this  aspect  of  comprehension  of  rate-modified  speech. 

In  consideration  of  the  complexity  and  difficulty  of  materials  there 
1s  also  at  Issue  the  type  of  learning  task  that  1s  Involved.  Different 
types  of  listening  learning  tasks  as  those  Identified  by  Rossi ter  (1971) 
yielded  differing  results  1n  terms  of  comprehending  rate-modified  passages. 
Further  exploration  of  different  learning  tasks  and  objectively  measuring 
their  completion  may  help  to  determine  what  specific  tasks  may  be  more 
suited  for- Information  that  1s  modified  1n  rate  of  presentation. 

In  order  to  measure  the  effectiveness  of  rate-modified  speech,  it  1s 
of  major  concern  to  establish  a  means  of  standardizing  the  degree  of 
.  complexity  of  stimulus  passages  and  the  use  of  augmentation  with  the 
stimulus  passages  for  testing  and  evaluation  purposes.  This  standardization 
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1s  Imperative  for  determining  results  from  an  experiment  and  for  general- 
izing to  other  research  efforts  relative  to  this  area  of  investigation. 

Orr  (1971)  Identified  the  problem  that  exists  due  to  a  lack  of  stan- 
dardization of  testing  Instruments  to  measure  variables  relative  to  rate- 
modified  speech.   Since  no  one  method  or  procedure  for  evaluating  rate- 
modified  materials  1s  recognized,  generalizations  from  one  study  to  another 
remain  difficult  to  make  and  are  frequently  of  questionable  validity. 

Until  the  present*  no  standardized  Instruments  have  been  developed, 

and  those  which  had  been  developed  represented  a  global  measure  of  a 

variety  of  learning  tasks.   Work  done  by  Rhetts  (1974)  suggests  that 

learning  research  should  also  focus  on  the  specific  learning  task  being 

presented.   Such  a  charge  would  Imply  that  specific  learning  tasks, 

presented  via  auditory  channels,  be  evaluated  using  Instruments  designed 

to  measure  achievement  of  each  of  those  specific  tasks.   For  this  reason, 

a  part  of  the  research  and  evaluation  materials  developed  by  Dwyer  (1967) 

was  employed  In  this  Investigation.   The  evaluation  Instruments  Incorporated 

Into  this  package  allow  the  researcher  to  evaluate  learner  achievement  % 

relative  to  four  different  learning  tasks  or  objectives:   drawing  or 

spatially  restructuring  Information,  terminology  or  recall  of  specific  . 

* 

Information,  Identification  or  spatial  analysis  and  comprehension  or 
Interrelating  Information.   In  addition,  a  total  test  measures  overall 

*Note:  The  term  "comprehension"  as  used  in  previous  research  relating 
to  compressed  speech  should  not  be  confused  with  the  term  Identifying  the 
Comprehension  Test  developed  by  Dwyer.   The  term  as  used  by  Dwyer  refers 
specifically  to  the  ability  to  "use  Information  to  explain  some  other 
phenomenon"  (Dwyer,  1972),  whereas  the  general  term  "comprehension"  refers 
to  a  more  generalized  ability  which  could  Interchangeably  be  called 
learning  or  achievement. 
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achievement  on  all  tasks.   The  use  of  such  materials  would  seem  to  represent  . 

f 

a  more  precise  method  of  evaluating  achievement  or  comprehension  of  Informa- 
tion via  the  auditory  mode. 

*  *  # 

Procedure/Method 

The  stimulus  materials  consisted  of  the  2,000  word  Instructional  script 
on  the  parts  and  functions  of  the  human  heart  developed  by  Dwyer  (1972). 
A  professional  narrator  Mas  used  to  record  the  normal  version  of  the  audio 
tape  at  an  average  rate  of  150  words  per  minute.   A  compressed  version  of 
250  words  per  minute  was  provided  by  use  of  the  Variable  Speech  Control 
(VSC)  module. 

The  supplemental  verbal  materials  consisted  of  the  printed  text  of  the 
Instructional  script.  The  supplemental  visual  materials  consisted  of  the 
39  illustrations  Identified  by  Dwyer  as  the  simple  line  drawing  version  of 
the  Instructional  materials  on  the  human  heart.   These  visuals  were  35mm 
slides  produced  with  black  lines  on  a  white  background.  The  slides  were 
synchronized  to  the  audio  script  via  a  Wollensak  2550  cassette  tape  recorder 
at  the  locations  in  the  instructional  script  when  Dwyer  determined  that 

a  visual  was  needed. 

The  accompanying  four  achievement  tests  developed  by  Dwyer  (drawing 
test,  terminology  test,  Identification  test  and  comprehension  test)  were 
employed  as  evaluation  Instruments. 

The  population  for  this  study  consisted  of  40  graduate  students  at 
the  University  of  Pittsburgh.   Care  was  taken  to  exclude  any  Individuals 

9  v 

having  ha.d  prior,  formal  training  in  medicine,  physiology  or  anatomy  as 
well  as  any  subjects  trained  in  Cardiopulmonary  Resuscitation  (CPR). 
Students  also  excluded  from  the  study  were  those  with  a  diagnosed  hearing 

p 
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loss  or  visual  1m*1rment  as  well  as  students  who  did  not  speak  English  as 
a  first  language. 

Subjects  were  randomly  assigned  to  one  of  the  four  treatment  groups: 
Normal  version/no  augmentation.  Compressed  version/no  augmentation, 
Compressed  version/text  augmentation.  Compressed  version/ visual  augmentation. 
Small  groups  listened  to  their  respective  versions  of  the  script  augmented 
by  text  or  visuals  where  applicable.'  Upon  completion  of  the  experimental  . 
treatments  the  subjects  were  Immediately  administered  the  four  achievement 


tests. 


Findings 

One  way  analyses  of  variance  were  calculated  to  determine  1f  differences 
existed  among  the  means  of  the  four  treatment  groups  for  each  of  the 
achievement  tests.   Where  overall  F  values  were  found  to  be  significant, 
Scheffe  post  hoc  comparisons  were  conducted. 

The  means  &d  standard  deviations  for  each  of  the  four  treatment  groups 
(Normal  version/no  augmentation,  Compressed  version/no  augmentation, 
Compressed  version/printed  text  augmentation,  and  Compressed  version/visual 
augmentation)  across  the  five  objective  tests  (the  drawing  test,  the 
terminology  test,  the  identification  test,  the  comprehension  test,  and  the 
total  test)  are  presented  1n  Table  1., 

The  results  of  the  analyses  of  variance  for  each  of  the  achievement 
tests  are  presented  1n  Table  2. 

An  F  value  of  3.41  was  obtained  for  the  drawing  test.  This  value  was 
significant  at  the  .028  level.  Pairwise  comparisons  among  means  were  con- 
ducted via  the  Scheffe  test.  Results  of  the  test  indicated  that  treatment 
4,  the  compressed  version  (250  worn)  with  the  visual  augmentation  group 
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TABLE  1 

Means  and  Standard  Deviations  of  the  Four  Treatment  Groups 


Normal /no         *  Compressed/no  Compressed/  Compressed/ 

augmentation  augmentation  printed  text  visuals 


N  - 

10 

N  « 

10 

N  - 

10 

N  - 

10 

I 

S.D. 

J 

S.D. 

J 

S.D. 

IT 

S.D. 

Drawing  test 

6.30 

3.83 

4.90 

4.63 

6.60 

5.04 

10.90 

4.15 

Terminology  test 

13.00 

3.77 

8.00 

3.43  . 

10.30 

3.13 

9.-20 

4.39 

» 

Identification  test 

11.50  / 

5.52 

8.20 

3.79 

9.60 

2.72 

11.30 

4.00 

Comprehension  t^st 

11.40- 

2.67 

8.60 

3.20 

11.40 

3.24 

8.04) 

2.75 

Total  test 

42.20 

12.50 

29.70 

12.12 

38.00 

11.40 

39:40 

12.40 
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TABLE  2 

Besults  of  tM  Analyses  of  Variance 


Test 


3.41  .028 
3.31  .031 


Drawing  test  <• 
Terminology  test 

Identification  test  1.42  .254 

Comprehension  test  3.68  .020 

Total  test  1.97  -136 
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achieved  significantly  higher  than  did  treatment  2,  the  compressed  version 
(250  wpm)  with  no  augmentation  group.   Ho  other  significant  differences 

were  found.  * 

An  F  value  of  3.31  was  obtained  for  the  terminology  test.   This  value 
was  significant  at  the  .031  level.   Comparisons  among  the  means  via  the 
Scheffe  procedure  Indicated  that  treatment  1,  the  normal  version  (150  worn} 
with  no  augmentation  achieved  -significantly  better  than  treatment  2,  the 
compressed  version  (250  wpm)  with  no  augmentation. 

An  F  value  of  1.42  was  obtained  for  the  Identification  test.  This 
value  was  not  significant  (p  ■  .254). 

An  F  value  of  3.68  was  obtained  for  the  comprehension  test.  This  value 
was  significant  at  the  p  -  .020  level.  However,  palrwlse  comparisons  via 
the  Scheffe  procedure  indicated  no  significant  differences. 
*    An'  F  value  of  1.97  was  obtained  for  the  total  test.,  This  value  was  not 
significant  (p  *  .136). 
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Conclusions  ami  Discussion 

A  number  of  conclusions  can  be  drawn  from  the  analyses  obtained  In  this 
stuo>;  j 

With  regard  to  a"  spatial  restructuring  task  as  measured  by  the  drawing 
test;  ' 

1.  _  Visual  augmentation  to  compressed  speech  Is  more  effective  than 
compressed  messages  presented  without  augmentation.   It  Is  clear  that  a 
task  such  as  this  relies  heavily  upon  spatial  Information.   Such  Information 
1s, provided  by  the  visual  material  used  to  augment  the  compressed  recording. 

2.  The  data  further  suggest  that  1n  those  cases  where  no  visual  aug- 
mentation 1s  provided,  both  compressed  and  normal  messages  are  equally 
effective.   Such  a  conclusion  would  lend  support  to  the  use  of  compressed 
messages  regardless  of  augmentation  In  those  cases  where  Instructional 

efficiency  In  terms  of  time  Is  destrable. 

*W1th  regard  to  the  recall  of  specific  Information  as  measured  by  the 
terminology  test: 

1.  The  evidence  suggests  that  normal  presentation  rates  are  superior 
to  compressed  rates  when  Information  1s  technical  In  nature. 

2.  In  those  cases  where  compressed  presentation  rates  are  used*  aug- 
mentation of  any  type  does  not  appear  to  be  a  significant  factor. 

With  regard  to  spatial  analysis  tasks  as  measured  by  the  Identification 
tes^:  . 

1.  The  data  suggest  that  compressed  messages  do  not  differ  from 
normal  messages  1n  terms  of  their  Instructional  effectiveness.   For  this 
reason,  rate-modified  messages  may  be  considered  instructional ly  more 
efficient  1n  terms  of  time  with  no  loss  of  effectiveness. 

With  regard  to  the  Interrelationship  of  information  as  measured  by 
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the  comprehension  test: 

1.  Evidence  Indicates  that  for  a  task  of  this  nature  compressed  mes- 
sages do  not  appear  to  differ  significantly  1n  their  Instructional  effec- 
tiveness from  those  presented  at  a  normal  rate  of  speed. 

It  Is  of  Importance  to  note  that  although  a  significant  F  value  was 
•obtained,  no  significant  palrwise  comparisons  could  be  Identified.  Such 
a  finding  would  make  the  above  conclusion  tentative  and  may  suggest  a  need 
for  further  research. 

With  regard  to  overall  understanding  of  technical  Information  as 

measured  by  the  total  test: 

1.  The  data  suggest  that  no  reason  exists  to  believe  that  compressed 
messages  differ  in  Instructional  effectiveness  from  normal  rate  messages 
when  the  Information  presented  1s  technical  1n  nature. 

2.  The  data  further  Indicate  that  compressed  and  normal  speed  materials 
are  not  equally  effective  1n  facilitating  student  achievement  of  different 
Instructional  objectives.  The  rate  of  presentation  most  effective  In  pre- 
senting Information  1s  dependent  upon  the  type  of  learning  task. 

3.  The  effectiveness  of  a  particular  type  of  augmentation  to  a  compressed 
passage  Is  dependent  upon  the  required  Instructional  task. 

The  fact  that  various  types  of  augmentation  to  compressed  materials 
represent  varying  degrees  of  Information,  redundancy  should  be  further 
explored. 

4.  The  degree  of  Information  redundancy  provided  by  varying  types  of 
augmentation  techniques  does  not  appear  to  be  related  to  the  overall 
Instructional  effectiveness  of  the  message.  Although  the  overall  degree  of 
redundancy  differed  from  1001  In  the  text  augmentation  version  to  slight 
redundancy  1n  the  visual  (labels  of  terns  on  diagrams),  the  effectiveness 
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of  those  techniques  appears  to  be  more  directly  related  to  the  type  of 
information  useful  In  completing  the  learning  task. 

The  findings  of  this  study  strongly  suggest  that  furtb'  -  research  be 
conducted  to  confirm  or  dlsconflrm  the  hypothesis  that  verbal  and  visual 
augmentation  of  rate-modified  speech  1s  an  effective  supplement  1n  the 
learning  of  technical  Information.   Research  should  focus  on  more  specifically 
analyzing  the  stimulus  passages  utilized  with  regard  to  their  complexity, 
readability,  density  of  Ideas,  and  length.   Further  research  should  also 
address  the  use  of  augmentation  which  varies  In  Its  degree  of  visual  com- 
plexity and  redundancy. 


574  56* 


BIBLIOGRAPHY 


Adelson,  L.   (1975)  Comprehension  by  college  students  of  time-compressed 
lectures.   Journal  of  Experimental  Education,  44,  53-60. 


Duker,  S.   (1974)  Summary  of  research  on  time-compressed  speech.  In 

S.  Duker  (Ed.),  Time-compressed  speech:  An  anthology  and  bibliography. 
Vol.  I  (pp.  478-501).  Metuchen,  NJ:  Scarecrow  Press. ; 

Dwyer,  F.M.   (1967)  Adapting  visual  Illustrations  for  effective  learning.* 
Harvard  Educational  Review.  37,  250-263.  ,~ 

Dwyer,  F.M.   (1972)  A  guide  for  Improving  instruction.   State  College,  PA: 
Learning  Services. 

Foulke,  E.    (1966a)   Comparison  of  comprehension  of  two  forms  of  compressed 
speech.    Exceptional  Children.  33,  169-173.  \ 


Foulke,  E.    (1967)  The  comprehension  of  rapid  speech  by  the  blind— Part  III 
(Interim  Progress  Report,  Cooperative  Research  Project  Ho.  2430). 
Washington,  OX:   United  States  Department  of  Health,  Education  and  . 
Welfare,  Office  of  Education. 

Foulke,  E.    (1968a)   The  perception  of  time- compressed  speech.  Manuscript 
prepared  for  The  Perception  of  Language  conference,  January  11  and.  12, 
Pittsburgh,  PA:   University  of  Pittsburgh. 

Foulke,  E.    (1968b)   Listening  comprehension  as  a  function  of  word  rate. 
The  Journal  of  Communication,  18,  198-206. 

Foulke,  E.    (1971)  A  comparison  of  harmonic  compression  and  compression  by. 
the  sampling  rsthod.  AFB  Research  Bulletin.  23,  TOO- 102. 

Kausfeld,  S.    (1981)  Speeded  reading  and  listening 'comprehension  for  easy 
and  difficult  materials.   Journal  of  Educational  Psychology.  73,  312-319. 

Nichols,  R.G.and  Stevens,  L.A.   (1957)  -Are  You  Listening?  Hew  York: 
McGraw-HUl. 

»  * 

Olson,  J.S.  and  Berry,  L.H.    (1982,  May)  The  state  of  the  art  1n  rate-. 
modified  speech:  A  review  of  contemporary  research. Paper  presented 
at  the  annual  convention  of  the  Association  for  Educational  Communications 
and  Technology,  Dallas,  TX, 


ERIC 


575 


562 


-16- 

\ 

Orr,  D.B.    (1968)  Time-compressed  speech— A  perspective.   Joum!  of 
Communication, 118,  288-292. 


Orr,  D.B.    (1971)   A  perspective  on  the  perception  of  time -compressed  speech. 
In  D.L.  Horton  and  J.J.  Jenkins  (Eds.),  Perception  of  language  (pp. 
108-119).   Columbus,  OH:  Merrill. 

Reld,  R.H.   (1968)  Gramnatlcal  complexity  and  comprehension  of  compressed 
speech.   Journal  of  Communication,  18,  236-242. 

i 

Rhetts,  J.E.    (1974)  Task,  learner  and  treatment  variables  1n  Instructional 
design.   Journal  of  Educational  Psychology.  66,  339-347.  , 

Rosslter,  C.H.,  Jr.    (1971)   Rate  of  presentation  effects  on  recall  of  ftcts 
and  of  Ideas  and  on  generation  of  Inferences.   Audio  Visual  Communication 
f         Review.  1£,  313-324. 

St  vers  tone,  D.M.    (1974)   Compressed  speech.   Audiovisual  Instruction,  19(1), 
42-43. 

Splcker,  H.H.    (1963)   Speech  rate  and  comprehension.   In  E.  Foulke  (Ed.), 
Time-compressed  Speech,  Vol.  II  (pp.  778-784).   Metuchen,  NJ: 
Scarecrow  Press. 


ERIC 


563 

5*8 


\ 


Relationship  Between  Dogmatism ,  Self-Esteem , 
Locus  of  Control ,  and  Predisposition  Toward 
Two  Instructional  Methods  Among  Female 
Nursing  Students 


o 

Submitted  for  presentation  at  the  1985  Convention 
of  the  Association  for  Educational  Communication 
and  Technology 

Anaheim,  California 


Submitted  by:  Robert  A.  Rehn,  Ed.D.  j 

Director  of  Media  Services 
Loyola  University  of  Chicago 
,820  N.  Michigan  Avenue 
Chicago,  Illinois    60611  J 


i 


564 

578 


Introduction 
The  study  of  personality  traits,  instructional 
methodologies  and  the  interaction  between  the  two  is  not 
a  new  area  of  study*    Studies  of  these  interactions, 
by  their  nature,  pose  such  general  questions  as: 
(1)  Do  complex  learner  aptitudes  interact  (either  posit- 
ively or  negatively)  with  methods  of  instruction  to 
predispose  certain  learners  to  success  or  failure  in  a 
given  instructional  setting?    (2)  Should  it  not  be  the  task 
of  educators  to  research  and  analyze  these  interactions  and 
inform  teachers  of  the  possible  implications  of  the  use 
of  certain  instructional  methods  in  the  course  of  teach- 
ing?, and  (3)  If  interactions  between  learner  aptitudes 
and  instructional  methods  exist,  should  not  research 
be  undertaken  to  identify  instruments  which  will  assist 
the  teacher  in  identifying  learners  who  may  experience 
difficulty  in  learning  through  a  certain  instructional 
method?    This  study  attempted  to  investigate  just  such 
questions. 

Improving  a  student's  performance  in  the  learning 
situation  may  be  accomplished  by  presenting  -he  instruction 
in  a  manner  which  the  student  most  easily  comprehends 
and  accepts.1    The  introduction  of  audio-visual  materials 
and  independent  instruction  into  the  educational  process 
affords  increased  diversity  in  the  types  and  methods  of 


C.  «.  Charles,  Individualizing  Instruction 
,(St.  Louiss    C.  V.  Mosby,  1980;,  pp.  b4-yz. 
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Instructional  presentations  educators  make  available  to 
their  students.    Identifying  reliable  instrucments  to 
assist  the  educator  in  choosing  an  apprpriate  instruct- 
ional approach  for  each  student  is  a  task  confronted  by 
this  type  of  research*    The  task  of  this  study  was  to 
discover  the  relationship  between  students'  scores 
on  three  psychological  instruments  and  their  performance 
on  tests  of  cognitive  content  presented  tfcrougb  two, 
differing  instructional  approaches • 

Achievement  in  any  learning"  situation  is  dependent 
on  a  number  of  variables,  such  as  how  well  the  teacher 
to aches ,  how  pleasant  the  learning  environment  is,  and  how 
well  the  student  slept  the  night  be^tpe.  In  addition  to 
the  external  variable  which  may  be  present,  each  person 
comes  to  the  learning  situation  with  a  unique  set  of  • 

personality  traits  which  may  affect,  either  positively 

2 

or  negatively,  his  or  her  chance  for  success-  These 
traits  may  include  such  variables  as  intelligence,  anxiety, 
motivation  and  self-esteem.    Further  confounding  the 
learning  situation  is  the  possibility  of  interactions 
among  these  variable,  as  well  as  interactions  between 
the  variables  and  the  instructional  method- being  used. 
The  recognition  that  personality  traits  may  affect  a 
student's  performance  in  an  instructional  setting  is  an 


p 

James  A.  Wakefield,  Using  Personality  To  Individual- 
.||^nstruc^on    (San  Diego:  California  EdlT©,  inablishers. 
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important  step  toward  improving  the  educational  process.  , 
Attempts  to  increase  the  efficiency  and  effectiveness  of 
instruction  have  focused  on  many  variable  which  are  often 
present  in  any  learning  environment.    This  study  investr 
i gated  three  personality  traits  which  a  learner  will 
bring  to  the  instructional  setting. 

In  order  to  maximize  "the  potential  of  each  learner, 
individual  differences  must  be  considered  when  designing 
instructional  approaches.'    Educators  should  direct 
learners  in  the  same  intellectual  and  development  direct- 
ions, and  at  the  same  time  they  must  consider  the  different 

» 

methods  which  may  help  the  learner  achieve  their  learning 
goals.    To  deal  with  the  individual,  varying  methods 
must  be  made  available  to  the  learner  to  meet  his  or 
her  goals.  Thus,  the  task  assigned  to  educators  is  two- 
fold:   (1)  develop  diverse  activities  to  help  the  indiv- 
idual learner  achieve  his  or  her  educational  goals,  and 
(2)  devise  methods  of  student  assessment  to  assist 
students  in  determining  which  of  these  diverse  educational 
opportunities  will,  for  them,  yield  the  best  results. 
The  identification  of  potentially  successful  instructional 
methods  begins  with  an  Assessment  of  the  learner.  The 


2r.  m.  Gagne,  "Instructional  Variables  and  Learning 

Outcomes  "        isvaiiiation  of  Instruction:    Tssues  and 
•oblej 


dolts  ana  winexon,  1970),  ».J*J»»    »•  •?  1)££„a2d 
K.  J.  Dunn,  "Learning  Styles/Teaching  Styles:  Should 
They.  .  .  Can  They.  •  .  Be  Matched?,"  Educational 
Let&rship.  36,  No.  4  (1979),  PP  23$-244/r 
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educator  Should  have  the  ability  and  opportunity  to  admin- 
ister  personality  trait  assessment  instruments  which 
have  been  shown  to  be  related  to  achievment  in  the 

s 

methods  of  instruction  to  be  utilised*    This  study 
attempted  to  assess  the  relationship  between  student 
scores  on  three  personality  trait  instruments  and  the 
level  of  student  achievement  in  two  differing  instruct- 
ional settings* 

The 'following  questions  were  the  basis  for  this 

study: 

1*      Is  there  a  significant  difference  between 
the  pass/fail  performance  on  tests  of  content  taught 
through  mediated  self -instruction  and  tests  of  content 
taught  through  didactic,  large  group  lecture  instruction? 

2.      Are  there  significant  distinguishing  interact- 
ion characteristics  for  those  passing  or  failing  a  test 
of  content  and  scores  on  the  Dogmatism  Scale,  the  Internal' 
External  Scale  and  the  Self -Esteem  Inventory? 

The  following  are  the  limitations  imposed  upon 
this  study: 

1.     This  study  was  limited  to  nursing  students 
in  a  baccalaureate  degree  program  at  a  private,  urban 
institution* 

2*     Students  were  drawn  from  the  third  year 
nursing  class  orLLy  (first  year  of  actual  nursing  instruct- 
ion). 

.  .  582  568 
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3.     Only  female  nursing  students  were  included 
in  the  analysis* 
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The  concept  of  individual  differences  has  been 
explored  by  researchers  for  many  years.    All  people  do 
not  look  alike,  talk  alike  or  hold  the  same  beliefs. 
The  knowledge  that  people  differ  through  a  w?de  variety 
of  traits  is  the  point  from  which  this  research  has 
embarked.  All  types  of  Information  about  the  character- 
istics of  learners  has  been  collected  in  schools.  Such 
traits  as  nationality,  sex,  grade  point  average  and 
socioeconomic  background  pre  routinely  ascertained. 
In  addition,  various  psychological  attributes  of  the 
learner  are  often  evaluated  to  determine  the  intellectual, 
social  and  emotional  status  of  the  student.    These  measures 
are  often  used  to  place  students  in  homogeneous  groups 
within  the  school  for  instructional  purposes.  Student 
grouping  of  this  sort  are  attempt  to  mold  the  student 
to  the  instruction,  rather  than  mold  the  instruction  to 
the  student.    Cronbach  and  Snow  point  out: 

Aptitude  measures  and  educational  methods  should 
form  a  mutually  supportive  system.  Educational 
programs  need  to  be  designed  for  the  student  who  does 
not  fit  the  conventional  instruction,  and  classification 


■  *J.  W.  Brown,  K.  D.  Norberg  and  F.  Harcleroad, 
A-V  Instruction?  Technology.  Media  and  Methods  (New  Yorfc: 
McGraw-Hill,  1977;,    PP-  17-29. 
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procedures  need  to  be  designed  to  choose  the  right 
participants  for  each  such  program.    The  old  mandate 
was,  "The  institution  is  given}  try  to  pick  the  _ 

S arsons  who  fit  it*0    The  needed  mandate  is.  "Try  to. 
©sign  enough  treatments  so  that  everyone  will  be  able 
to  succeed  in  one  of  them,  and  route  the  person  into 
the  treatment  that  fits,"7 

Media  specialists  ^ave  often  been  called  upon  to 

produce  multiple  instructional  treatments  for  various 

instructional  settings.    Media  specialists  have  for 

years  espoused  the  importance  of  assessing  the  intended 

audience  for  which  they  are  designing  materials.  Any 

discussion  of  the  role  of  the  developer  of  instructional 

programs  will  include,  as  a  critical  component  of  the 

instructional  development  process,  th^  assessment  of  the 

intended  audience.6    The  purpose  of  this  assessment  is 

to  ascertain  that  the  instructional  treatment  being 

designed  will  meet  the  educational  requirements  of  the 

group  of  people  for  which  it  is  intended.    After  this 

assessment  is  completed,  materials  are  produced,  strategies 

determined,  environments  are  selected  and  evaluation 

instruments  prepared.^    The  results  are  often  presented 

as  a  series  of  scores  distributed  along  a  normal  curve. 

Yet,  if  this  instruction  was  designed  to  "fit"  this 

audience,  researchers  must  question  why  some  students  do 


^Lee  Cronbach  and  Richard  Snow,  Aptitudes  and 
Instructional  Method  (New  Xorks    Irvington,  1977;. 

^Brown,  Lewis  and  Harcleroad,  op.  cit.,  p.  19- 

?C.  Ef  Cavert,  An  Approach  to  the  Design  of  Mediated 
Instruction    (Washington,  D.  C.: Association  for  Educat- 
ional Communications  and  Technology,  197*) • 
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quite  well  and  others  do  poorly*    Perhaps  the  reason  is 
that  each  learner  brings  a  particular  set  of  attributes 
and  characteristics  to  the  learning  setting  which,  to 
a  degree  may  predispose  each  learner  to  success  or  failure 
in  that  setting* 

Glaser  identifies  individual  differences  as  a 
relevent  component  of  the  educational  process  and  calls 
for  the  assessment  of  these  differences  and  the  utili- 


zation  of  these  differences  in  planning  instructional 
strategies.     Cronbach  and  Snow  identify  personality 
traits  as  important  factors  when  considering  the  adapt- 
ation of  the  educational  process  to  the  individual. ^ 

The  investigation  of  interaction  between  treatments 
and  trait  variables  has  been  called  Trait-Treatment 
Interaction  (TTI)  or  Aptitude-Treatment  Interaction 
(ATI)  research.       In  ATI  studies  the  task  is  to  predict 
appropriate  learning  methods  for  subjects  possessing 
certain  levels  of  a  given  trait,  thus  allowing  them  to 
obtain  their  highest  level  of  achievement.  When  various 
differing  instructional  programs  are  available  within 
a  course  of  study,  interaction  patems  may  be  used 
to  predict  which  program  will  bring  about  the  best 
results  for  each  student. 


^Robert  Glaser,  "Individuals  and  Learnings    The  New 
Aptitudes,"  Educational  Researcher,  1  (1972),  5-13- 

^Cronbach  and  Snow,  op.  cit.,  pp.  2-6. 
10ibid. 
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Instructional  Methods 
The  verbal  instruction  most  commonly  observed  in 

the  lecture  hall  at  many  schools  is  an  excellent  example 

*  ^  j.  .    w  ,11        u4  4.*«»-J2  have  called  "expository 
of  what  Ausbel     and  Wittrock 

teaching*"  In  this  type  of  instructional  setting,  the 
learner  is  required  to  list em.  and  perhaps  take  notes, 
while  the  instructor  poses  questions  and  then  answers  them* 
-Lecture  is  a  passive  mode  of  learning  which  allows  little 
chance  for  asking  questions  or  responding  with  answers. 
While  the  passivity  of  lecture  is  a  drawback  when  attempt- 
ing   to  involve  students  in  their  own  learning  and  adapt 
instruction  to  each  individual  learner,  it  can  still 
provide  useful  learning  experiences*    When  properly 
organized,  expository  teaching  L«~n  present  facts,  -concepts 

and  principles  which  students  can  learn  and  use  as  a  basis 

13 

for  further  learning  and  study. 

The  process  of  learning  is  unique  to  each  indivi- 
dual. The  educational  system  makes  various  experiences 
available  to  each  student*    The  schools  provide  materials, 
facilities",  resources  and  instructors.    The  learner  also 
brings  certain  traits  to  the  learning  experience.  Gagne 

*■ 

stresses  the  import nace  of  viewing  the  educational  process 


11D*  p.  Ausbel,  The  Psychology  of  Meaningful  Verbal 
Learning:  An  Introduction  to  School  .beaming  mew  xorg? 
Grune  and  Stratton,  1965;,  p.  19*  ~ 

12M.  C.  Wittrock,  "Verbal  Stimuli  in  Conoept  Form- 
ation: Learning  By  Discovery,"  Journal  of  Educational 
Psychology.  64  (1963),  pp.  183-190. 

^Ausbel,  loc.  cit. 
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as  a  systematic  presentation  of  instruction  to  diverse 
and  constantly  adapting  individuals,    ^he  focus  of  educ- 
ation must  be  the  student ""According  to  Edling,^ 
independent  instruction  is  the  methodology  which  seems  > 
to  be  the  most  flexible  and  adaptable  to  the  differences 

■T 

I 

between  learners.    In  his  discussion  of  individualization 
of  instruction,  Edling  identified  independent  instruction 
as  the  method  which  provides  the  most  freedom  to  the 
learner.       Independent  instruction  gives  the  student 

•  \ 

the  opportunity  to  make  decisions  concerning  the  location 
and  time  of  the  instructional  experience,  the  materials 
to  be  used  and  the  rate  at  which  they  will  be  assimilated. 1? 
One  or  more  of  these  decisions  may  be  the  single  most 
important  component  in  adapting  the  instruction  to  the 
student.    Often,  more  than  one  of  these  components  is 
able  to  be  manipulated  by  the  student  in  independent 
instruction.    The  way  students  manipulate  their  If arning 
environment  is  as  much  a  function  of  their  personality  as 
is  the  way  they,  learn. 


Robert  M.  Gagne,  "Instructional  Variables  and 

.on  of  Instruction:  Issues 
and  S.,  Wiley  (Kew  ¥ork: 
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16Ibid. 

^Brown,  Lewis  Harcleroad,  opv'cit.,  pp.  22-29. 
Ibid. 
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The  teasing  of  audiovisual  instruction  with 

independent  study  is  a  methodology  which  has  gained 

increasing  popularity  in  higher  education  in  the  last 

ten  years.    The  creation  of  learning  centers,  facilities 

where  students  learn  independently   through  the  use  of 

19 

audiovisual  materials,  is  widespread.    Sullivan  7  lists 

1,778  individual  learning  centers  in  colleges  and 

universities  in  the  United  States  and  Canada.  Learning 

centers  are  defined  as  facilities  where  materials,  both 

20 

print  and  non-print,  are  stored  and  utilized.  In 

addition,  these  learning  centers  often  become  the  area  in 

21 

a  school  where  independent  instruction  is  implemented. 
Anderson22  described,  this  center  as  a  place  where  students 
interact  with  materials  while  working  in  an  independent 
instructional  mode.    It  is  in  these  centers  that  the 
technology  of  education  meets  independent  instruction  to 
form    mediated  self -instruct ion.    Learning  centers  allow 
students  to  function  independently.    Students  may  schedule 
their  time,  arrange  their  work  space  and  freely  access 


19£.  L.  Sullivan,  Guide  to  Learning  Centers  in 
Higher  Education  (Portsmouth,  N.  H. :  Entelek  Press,  1979) . 

20J.  W.  Brown,  K.  J),  Norberg  and  S.  K.  Srygley, 
pp.  3o-4oV 

^Brown,  Jfforberg  and  Harcleroad,  op.  cit.,  pp.  34-37  < 

22Robert  Anderson,  "Sustaining  Individualized 
Instruction  Through  Flexible  Administration, w  The  Computer 
in  American  Education «  eds.  1*.  Bushnell  and  D.  Allen 
f»ew  York  s    Hcfiraw-Ell,  1967), 
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technological  resources  and  multiple  modes  of  communica- 
tion,2'   Thus,  if  education  is  to  adapt  to  the  needs  of 
the  learner,  it  would  seem  that  mediated  self -instruction 
in  special  learning  centers  designed  specifically  for 
that  methodological  approach  would  be  the  most  appropriate 

place  to  study  instruction  and  learner  aptitudes.  ' 

V 

Personality  Variables 

Dogmatism 

Oh. 

Dogmatism  is  defined  by  Rokeach     as  a  component 
of  a  person's  personality  which  defines  the  degree  %o 
which  a  person  can  evaluate,  accept,  and  act  on  on 
relevent  inf  o-rmation  independent  of  extraneous  outside 
factors.    A  person's  level  of  dogmatism  can  be  classified 
somewhere  along  a  continuum  which  ranges  from  "open" 

i 

to;  "closed."    An  open  belief  system  is  one  which  allows 
the  individual  to  accept  new,  novel  and  often  conflicting 
information  and  integrate  this  information  into  his  cr  j 
her  belief  system.    People  with  open  belief  systems 
are  often  characterised  as  broad-minded,  liberal,  tolerant, 
receptive  and  unprejudiced.    New  information  may  be 
integrated  rapidly,  even  if  this  means  that  old  beliefs 
must  be  modified  or  discarded.    A  closed  system  of  beliefs 


i  25 

|         •'Brown,  Lewis  and  Harcleroad,  loc.  olt« 

\    !  24M.  Rokeachi  ^he  Open  and  Closed  Mind  (New 

^ork:  Basic  Books,  1960)-  / 
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is  one  that  defends  itself  against  conflicting  information. 
The  person  with  a  closed  belief  system  is  often  hesitant 
to  accept  input  which  negates  or  disproves  currently 
held  belief  a.    Closed  belief  individuals  (high  dogmatics) 
are  often  characterized  as  narrow-minded,  intolerant,  rigid 
and  prejudices.^ 

1        High  dogmatics,  then,  may  be  supposed  to  resist 
.    and  perhaps  reject  unfamiliar  and  possibly  threatening 
'f"  new  situations.    Students  who  test  as  highly  dogmatic 
ms&  carry  with  them  a  predisposition  to  failure  (or  at 
least  diminished  performance)  when  confronted  with  the 
mediated  self -instruction  methodology  of  education. 

Self-esteem  ' 

In  the  study  done  by  Cooper smith     self-esteem  is 
defined  as  a  person's  evaluation  of  himself.  Self-esteem 
is  the  manifestation  of  the  approval  or  disapproval  one 
feels  about  his  or  her  own  skills,  intellectual  abilities, 
aptitudes  and  morals.    It  is  a  "personal  -judgement  of 
worthiness  that  is  expressed  in  the  attitudes  the  indiv- 
idual holds  toward  himself. Coopersmith  found  a 


25Ibid.' 


Stanley  Coopersmith s  The  Antecedents  of  Self 
Esteem.  San  Francisco s    W.  H  Freeman,  1967). 

■^xbsavp.  5T 
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high  correlation  between  self -esteem  and  creativity* 
He  considered  self-esteem  a  critical  factor  in  determining 
the  degree  to  Which  a  person  can  act  confidently  and 
success     ly  on  an  independent  basis.  Self-esteem 
also  relates  to  the  ability  of  a  person  to  organize 
chaos  into  order.29  "fcoopersmith  also  found  that  self- 
esteem  correlated  with  achievement  and  so ci ©metric 
choice.^ 

Locus  of  Control 

Locus  of  control  can  be  defined  as  a  measure  of 
the  degree  to  which  a  person  believe  she  or  he  controls 
reinforcement  (reward)  for  his  or  her  own  actions. 
Hotter i *    in  his  social  learning  theory ,  attempts  to 
explain  behavior  through  "expectancy"  and  reinforcement 
"value."    The  behavior  of  an  individual  can  be  predicted 
if  it  can  be  determined  to  what  extent  that  behavior  will 
lead  to  reinforcement  and  what  the  value  of  the  reinforce - 
Dent  "is.    Individuals  place  different  values  on  the 


Ibid. 


28Ibid.  29 

^Stanley  Coopersmith,  "A  Method  of  Determining 
Types  of  Self  Esteem."  Journal  of  Abnormal  and  Social 
Psychology.    59  (1959),  90.  r 

^J.  B.  Rotter,  Social  Learning  and  Clinical 
Psychology   (New  York?  Prentice-Ball, 


e 

ERIC 


577 
591 


14 


importance  of  external  reinforcement  in  governing  their 
actions.    The  ability  to  assess  the  importance  of  rein- 
forecement  to  the  individual  is  critical  in  anticipating* 
behavior*    Hersch  and  Scheibe^  found  that  individuals 
evaluated  as  being  "internals"  (belief  in  control  of 

9 

their  own  reinforcement),  describe  themselves  as  being 
assertive,  independent,  powerful,  effective  and  indust- 
rious •    Internal  control  has  been  shown  to  be  positively 
correlated  with  motivation*^    Externals  (viewing 
reinforcement  as  coming  from  outside  their  control) 
are  described  as  more  aggressive  and  hostile ,  suspicious 
"and  mistrustful,^  and  more  dogmatic  and  authoritarian.^ 
External  control  has  been  shown  to  correlate  positively 

with  debilitating  anxiety  while  internal  control  correlates 

V? 

with  facilitating  anxiety. 


^2P.  D.  Hersch  and  K.  E.  Scheibe,  "On  the  Reliability 
and  Validity  of  Internal-External  Control  as  a  Personality 
Dimension,"    Journal  of  Consulting  Psychology.  31  (1967) t 
609-614. 

"j.  B.  Rotter  and  R.  Mulry,  "Internal  versus 
External  Control  of  Reinforcement  and  Decision  (Time." 
Journal  of  Personlaity  and  Social  Psychology ,  4  (19&5)« 
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3^C.  B.  Williams  and  E.  L.  Ventres s,  "Relation 
Between  Internal-External  Control  and  Aggression," 
Journal  of  Psychology.  71  (1969),  59-61. 

^5A.  &•  Miller  and  H.  L.  Mint  on,  "Kachiavelianism, 
Internal -External  Control  and  the  Violation  of  Experimental 
Instruction,"  Psychological  Record.    19,  (1969),  369-360. 

b.  Rotter,  M.  Seeman  and  S.  Liv«rant ,  "Internal 
versus  External  Control  of  Reinforcement:  A  Jajor  Variable 
in  Behavior  Therapy,"  Decisions.  Values  and  Groups,  ed. 
N.  P.  Washburn  (London:  Pergamon,  T§fe2;,  47?->ib. 

^?E.  C.  Butterfield,  "Locus  of  Control,  Test  Anxiety, 
Reaction  to  Prostration,"  Journal  of  Personality.  32 
(1964),  298-311.  .  R0- 
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DESIGN  OF  THE  STUDY 

V 

Background 

Thia  study  meets  the  traditional  definition  of  an  experimental 
design  as  defined  by  Ker linger.1   By  measuring  differences  in 
performance,  the  study  attempted  to  determine  the  effect  personality 
traits  (dogmatism,  locus  of  control,  and  self-esteem)  have  in  two 
varying  instructional  settings. 

This  study  was  designed  as  e  modified  Fosttest  Only  Control 

2 

Group  design,  as  defined  by  Campbell  and  Stanley,     Rather  than 
compare  one  experimental  group  to  a  control  group  which  has  received 
no  treatment,  the  study  compared  two  groups  which  have  received  the 
same  instruction  through  two  different  methodologies.    The  form  of 
the  design  is  Illustrated  below: 

r  XI  01 

r  X2  02 

with  XI  being  the  lecture  method  and  X2  being  the  mediated  self- 
instruction  treatment.    The  subjects  were  randomly  assigned  to  each 
group  to  meet  the  assumption  of  statistical  equivalence  of  the  groups 


Scerlinger,  Foundations  of  Behavioral  Research,  pp.  327-346. 

2 Donald  Campbell  and  Julian  Stanley,  Experimental  and  Quasi- 
experimental  Peslena  for  Research  (Chicago s    Rand  HcSally  College 
Publishing  Company,  1963),  p.  25. 
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prior  to  the  introduction  of  the  treatment  variable. 

Pour  instruments  were  need  to  collect  data:    Rotter' a 
Dogmatism  Scale  (OS),  Rokeach'a  Internal-External  Scaje  (IE), 
Cooper  ami  tV  a  Self  Eateem  Inventory  (SEI)  *ad 
multiple  choice  poatteat  for  content  on  Tracheostomy  Care  (Trach)  and 
Intravenous  Therapy  (I.V.) 

Sample 

Subjects  for  this  study  'fere  drawn  from  female  students  in  the 
third  year  class  of  the  School  of  Nursing  at  Loyola  University  of 
Chicago  (»  -  159).    The  majority  of  the  students  in  the  sample  were 
under  22  years  of  age  (90.6  percent),  had  a  grade  point  average 
between  2.50  and  3.40  (73  percent)  and  hid  no  other  post-secondary 
degrees  (88.1  percent)  As  the  nursing  curriculum 

et  Loyola  is  an  upper-division  major,  third-year  (junior)  studenta 
are  actually  taking  their  first  nursing  classes  in  the  first 
semester  of  their  third  year.    Because  mediated  self-instruction  waa 
one  of  the  treatments  to  be  investigated,  the  effect*  of  the  treatment 
on  the  performance  may  be  more  obvious  on  students  relatively  unfamiliar 
with  this  novel  instructional  setting. 

Croup  Design 

'     Two  treatment  groupe  were  deeigned  through  cluster  sampling. 
This  technique  was  required  because  of  the  instructional  groupings 
imposed  upon  students  by  the  demands  of  the  nursing  curriculum.  The 


3Kerlinger,  op.  cit.,  p.  130. 
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School  of  Nursing  a r rang**  students  into  "master  groups"  which  are  in 
turn  grouped  togehtcr  into  clinical  agency  teas*.    There  are  no  more 
than  ten  students  in  each  asster  group,  and  a  clinical  team  is  composed 
of  either  three  or  four  neater  groups .    There  were  five  clinical 
teams  in  the  junior  class,  and  yearns  were  assigned  randomly  to  one  of 
the  two  experimental  groups.    Also,  it  should  be  noted  that  individual 
students  were  assigned  to  clinical  teams  on  a  random  basis. 

Data  Gathering  Instruments 

There  were  two  areas  in  which  data  concerning  the  subjects 

♦ 

were  needed:    (1)  their  performance  on  two  tests,  and  (2)  their  scores 
on  three  personality  scales.    Two  post teste  were  used  to  assess 
students'  understanding  of  the  lessons  on  Tracheostomy  and  Intravenous 
Therapy.    These  instruments  had  been  used  in  the  School  of  Nursing  for 
two  years  previous  to  this  research  and  had  been  constructed  from  the 
objectives  of  the  lessons  in  question.    These  instruments  had  been 
evaluated  for  content  by  a  team  of  eight  nursiu^  instructors  and  had 
proved  to  be  valid  through  two  years  of  use.    The  objective  test  to 
assess  the  students'  understanding  of  the  content  presented  dealing 
with  Tracheostomy  care  consisted  of  27  multiple  choice  questions.  The 
objective  tettt  of  the  content  dealing  with  Intravenous  Therapy  consisted  of 
21  multiple  choice  items.    These  tests  are  criterion  referenced: 
students  are  normally  required  to  complete  these  tests  as  many  times  , 
as  necessary  until  they  peas.    A  passing  grade  of  70  percent  was 
established  by  the  school  curriculum  committee.    Thus,  students  must 
correctly  answer  19  questions  to  pass  the  Tracheosomy  test  and  IS  questions 
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to  pui  the  Intravenous  Therapy  test.    Only  the  students1  first  efforts 
on  each  test  were  Included  in  the  dete  analysis.    In  the  analysis, 
student  scores  were  recorded  to  one  (1)  for  a  passing  grade  and  sere 
(0)  for  e  felling  grede.    This  wss  done  to  provide  a  dichotomous 
variable  for  the  diacriminant  analysis  of  the  data.  Reliability 
calculations  (Kuder-Richardson)  were  conducted  on  both  exams.  These 
calculations  ahowed  a  reliability  coefficient  of  .720  for  the  Trache- 
ostomy^exam  and  a  .673  for  the  Intravenous  Therapy  exam. 

The  personality  traits  to  be  studied  were  assessed  through  the 
use  of  the  Dogmatism  Scale,  the  Internal-External  Scale  and  the  Self 

esteem  Inveutory.  These  instruments  were  used  in 

4 

their  modified  form  for  adults,  as  described  by  Frerichs.  The 
combination  of  the  three  scales  created  an  instrument  127  items  in 
length  (not  counting  the  five  demographic  data  items  which  preceded 
the  three  personality  scales). 

The  Dogmatism  Scale  (DS)  is  a  40-item  scale  consisting  of  a 
series  of  statements  formulated  to  meeeure  the  openn-ss  of  the 
individual's  belief  system.    The  formet  of  the  instruments  is  an 
"agree-dieegree"  forced  choice  design.    All  40  statements  are  phrased 
in  a  dogmatic  manner.    If  the  student  agrees  with  all  40  statements, 
he/she  will  have  achieved  the  highest  possible  score  and  thus  will 
be  assessed  as  highly  dogmatic.    Rokeech  reports  a  mean  test-ret est 


Marian  Frerichs,  "Relationship  Between  Age,  Dogmatism, 
Internval  vs.  External  Control,  Self  Esteem  end  Crsds  Point  Average 
Among  Community  College  Huraing  Students,"  (Doctoral  dissertation, 
Northern  Illinois  University,  1971). 
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reliability  coefficient  oS  .74. 5   Altar"  and  White  reported  split-half 
teat-reteat  reliebility  over  five  monthe  of  .75  and  over  six  months 
of  .73.6   Other  studies  using  the  Dogmatism  Scale  revealed  essentially 

the  same  findings.7 

The  Internal-External  Scale  (IE)  is  a  29-iteo- forced  choice 
scale  with  two  • cat amenta  within  each  item.    Sub j acta  are  aafced  to 
chooae  one  of  the  two  statements  from  each  item  which  most  accurately 
statea  what  they  believe  to  be  true.    Oneetetement  is  an  "internal" 
locua  of  control  reeponsej  the  other  ia  an  "external"  locus  of  1 

e 

control  reapouse.    In  scoring  the  inetnaaent,  the  "external" 

answers  are  vtotalled.    Rotter  (1966)  reports  a  teat-rctest  reliability 

coefficient  of  .78  efter  a  one-month  period.8 

The  Self  Esteem  Inventory  (SEI)  ia  a  58-item  scale  in  which 
subjects  are  asked  to  decide  wnether  the  statements  are  "like  I 
uaually  feel"  or  "not  like  me."    Eight  items  included  among  the  58 
comprise  a  lie  scale  and  are  not  included  in  the  scoring.  The 
instrument  examinee  the  subjects'  self-esteem  in  four  areas:  peers, 
family,  schools,  and  personality  interests.    Scores  on  the  SEI  may 
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Rokeach,  The  Open  and  Cloaed  Mind,  pp.  89-90. 

6Richard  Alter  and  R.  J.  White.  "Some  Norms  for  the  Dogmatism 
Scale,"  Psychological  Resorts.  19  (1966),  pp.  967-969. 

7j.  B.  Bough  and  R.  Ober,  "The  Effects  of  Training  in  Inter- 

ani*J?Ctough  (Reading ,  Mas  ^ddiaon  WaeTey,  l5o7j. 

8J.  B.  Rptter,  "GnneraUsed  Expectancies  of  Internal  veraua 
External  Control,"  pp.  10-13. 
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rang*  from  zero  (0)  to  50.    The  higher  the  numerical  score,  the  higher 
the  level  of  self-estsem  indlcstsd  by  the  respondent.    Ti*c  Self 

Eeteen  Inventory  he.  produced  .  cast -rat  eat  reliability  coefficient  , 

9 

of  .88  efter  five  weeks  end  .70  reliebUity  after  three  years. 

A 

1  • 

J 

Treatment 

The  three  personality  profile  ins t moan t a  were  administered 
to  the  acudanta  by  their  master  instructor.  Students  were  allotted 
aa  much  time  as  they  needed  to  complete  the  three  instrument a. 

The  treatment  consistsd  of  the  vlewfMrof  po  instructional 

♦I 

lessons  by  each  of  the  two  treatment  groups.    One  group  ("A") ,  es  a 
whole,  viewed  a  lecture  on  care  of  the  patient  receiving  Intravenoua 
Therepy  and  they  were  then  assigned  to  view  at  some  time  in  the  next 
nine  weeks  a  f ilmstrlp/cassette  program  on  care  of  the  patient  with 
a  tracheostomy.    The  second  group  ("B")  viewed  a  lecture  on  care  of 
the  patient  with  Tracheostomy  and  were  aa signed  the  teak  of  viewing, 
a  filmstrip/cessstte  program  on  care  of  the  patient  receiving 
Intravenoua  Therepy.    The  two  lectures  were  constructed  around  the 
objectives  and  scrlptsd  statsments  contained  within  the  fil*strip/ 
casastts  programs.  Ths  lecturer  (who  gave  both  the  I.V.  and  the  Trach 
lectures)  was  given  an  outline  for  the  presentations  but  was  allowed 
some  latitude  in  pace  and  presentation  order.    In  this  way  content 
was  kspt  ss  uniform  as  possibls  between  the  two  treatments.    A  diagram 
of  ths  treatments  follow: 


9Coopersmith,  Th*  Anteced>«f  °*  Salf  Esteem,  p.  18. 
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After  viewing  their. re.«.ctlv.  lecture.,  th.  etudent.  were  ed*«i.t.r.d 
.„  obJ.ctiv.  t..t  to  «»ur.  their  co.opr.hen.icn  of  the  -tori*  vbich 
h.d  Jg>«  been  pre.ented  to  then.    Student,  wet.  el.o  required  to 
couplet.  .»  objective  ft  on  the  infor»etlo»  ,.re.e»t.d  to  th»  In 
the  required  -dieted  .«lf-in.tru«i,n«l  n.t.ri.1.   All  viewing  of 

..die  »«  «o-pi««*  i«  *•  Sch001  of  »<"»*»«*•  Le**nto8  R"°ur;e" 

Center.    Student.  ««.  .Uo«d  to  .ctodux.  their  own  tin.  for  jewing 
th.  valeted  pro,r»       co.pl.tJng  the  objective  te.t  on  thet  content. 

b* 

« 

Procedure 

All  .tudene.  la  the  .tuny  w.r.*«.k*d  "  collet.  •  p.r.oo*l 
profile  inventory  which  included  the  Dog-tU.  Seel.  «*).  the  I.t.n-1- 
Ext.rr-1  ScU.  (ID  *»•  th.  Self  «t.»  Inv^tor,  (SSI).  -Thi.  133-it- 
in.tn«»t  «.  rt-ini.t.r^  to  th.  .t»d«,t.  b,  their  «.t.r  l».tr»ctor 
2-3  before  the  t«et«nt  «.  .d-inUt«r.d.   St»d«e.  w.r.  told. 

th.t  th.  p«P«~  .r-th.  in.tru.-nt  «.  to  ******  *»•  •«"»*"  -1 
«1««  of  junior-yeer  nursing  .tudwf.   Student,  wer.  ...ur.d  thet 
th.  r-ult.  of  th.  lnv~t.rr  .ould  b.  eonfid-ti.1  .nd  would  in  no  «y 
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affect  th*J.r  grada  in  the  course. 

'    Trtttotnt  group  "A"  (N  -  67)  attended  a  Jb-minftte  lecture 
letting  forth  the  principle*  of  caring  for  the  patient  receiving 

•  •  •  * 

Intravenous  Therapy.'  Immediately  following  the  lecture  a  21-item 
paper  and  pencil  multiple  choice*  exam  vaa  administered,  testing  the 

0 

conprehenslon  of  that  neterlal  by  the  students  in  that  group.  Group 
"B"  (N  -  92)  attended  a  50-niuute  lecture  netting  forth  the  principles t 
of  caring  for  the  patient  with  a  Tracheostomy.    Following  that 

>  mm' 

.lecture,  e  2 7-1 tea  paper  end  pencil  multiple  choice  exam  testing 
that  content  wes  administered.    Both  lectures  were  given  by  the  seme 
School  of  Nursing  instructor  to  reduce  variance  due  to  lecturer's 
style  or  personal  charisma. 

Groups  A  and  B  were  easlgned  Independent  tasks,  to  be 
completed  by  the  end  of  the  semester  (approximately  9  weeks  after 
the  lectures)  is  the  School  of  Nursing  Learning  Resources  Center. 
Group  A,  which  had  attended  thevlecture  on  I.V.  Therapy^  was  assigned 
the  task  of  viewing  a  medieted  self-instructional0  filmstrip/cassette , 
program  on  caring  for.  the  patient  with  a  Tracheostomy.    Group  B, 
which  had  attended  the  lecture  on  Tracheostomy  care, -was  assigned  the 
task  of  viewing  a  mediated  self-instructional  filmstrip/cassette 
program  on  I.V.  Therapy.    Both  group*  were  required  to  complete  a 
paper  and  pencil  multiple  choice  exam  on  the  content  transmitted 
through  their  respective  filmstrip/cassette  program*.    After  viewing 
the  filmstrip/cassette  program  of  Tracheostomy,  Group  A  students  were, 
edministsred  the  same  test  as  bad  been  administered  the  Group  B 
students  after  the  lecture  on  that  subject.    Convirsely,  Group  B 
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students,  after  viewing  tfas  filmstrip/caesette  program  on  I.V.  Therapy, 
were  administered  the  same  tmt  as  h»d  been  completed  by  Croup  A  after 
jhe  intravenous  therapy- lecture.    Viewing  of  the  filmstrip/caesette( 
programs  use  collated  by  the  studeateAn  an  independent  basis  through- 
out the  course  of  the  semester.    Students  would  droF*»  to  the  LRC  at 
sny  tine  and  view  the  designated  program  on  their  own  tine  and  at 

•  m 

»  »      p  « 

thtlr  own  pae«. 

m 

Statistical  Treatment . 

After  the  data  had  heen  collected,  it  was  processed  using. the  ^ . 

sraEi.ticnl  Fack-r  Sg        fioglAl  8citfteM  <SPSS>/10  * 
analysla  wes  completed' to  assess  any  significant  difference*  between  % 
the  treatmante  (lecture  and  mediated  self-instruction)  and  the 
existence  of  interactions  between  any  of  the  variables  under 'study 
(lecture,  mediated  self-instruction,  dogmatism,  locus  of  control  -and 

self-esteem) . 

The  Statistical  Hull  Bypotheeea  tested  were: 

1.  There  are  no  significant  differences  between  the  performance 
of  the  two  treatment  groups  on  a  test  of  content  detailing  care  of  the 
patient  with  Intravenoue  T>*rapy. 

2.  There  are  no  significsnt  interactione  between  the  performance 
of  the  two  treatment  groups  on  test  of  content  detailing  care  of  the 

patient  with  Intravenous  Therapy  and  their  scores  on  the  DS  ,  IE,  and 

/  • 
SEI.  ^  ' 


10H.  H.  Me,  D.  H.-Bent  and  C.  H.  Hull,  flSjtUticml  Package 
tot  the  Social  Sciences  (New  York:    HcCrew-Hill,  1970), 
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3.  There  are  no  significant  differences  between  the  performance 
of  the  two  treetasnt  grouse  on  test  of  content  detailing  cere  of  the 
patient  with  e  Trecheosrosy. 

4.  There  ere  no  significant  interactions  between  students* 

<  •- 
performance  on  tests  of  content  detailing  cere  of  the  patient  with 

Tracheostomy  and  th>ir  ecoree  on  ths  SEI,  DS,  end  IE. 
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ANALYSIS  OF  DATA 


This  chapter  examines  the  data  which  were  collected  from 

the  investigation  of  the  research  questions.    The  questions  analyzed 

\ 

were:  \ 

if  Is  there  a  significant  difference  between  students' 

performance  on  tests  of  content  taught  through  didactic,  large 
grou,  J  ^struction  and  tests  of  content  taught  through  mediated  self- 
instruction? 

2.    Are  there  significant  interactions  between  students' 
scores  on  the  Dogmatism  Scale,  the  Internal-External  Scale,  and 
the  Self  Esteem  Inventory  and  students1  performance  on  tests  of 
contwt  taught  through  mediated  self-instruction  or  through  large 
group  lecture  instruction? 

Analysis  of  Hypotheses  9 

The  first  end  second  hypotheses  related  to  the  treatment 
variables  since  they  were  used  to  present  content  detailing  care  of 
the  patient  receiving  Intravenous  thsrapy.    The  statistical  treatment 
used  dictates  that  the  first  and  second  hypotheses  be  discussed 
simultaneously.    The  first  hypothesis  tested  was:    "There  are  no 
significant  differences  between  the  performance  of  the  two  treatment 
groups  on  a  test  of  content  detailing  care  of  the  patient  with 
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Intravenous  Therapy."    The  second  hypothesis  tested  was:    "There  are 
no  significant  interactions  between  the  performance  of  the  two 
treatment  groups  on  tests  of  content  detailing  care  of  the  patient 
with  Intravenous  Therapy  and  their  scores  on  the  DS  (Dogmatism  Scale) , 
the  IE  (Internal-External  Scale) ,  and  the  SEI  (Self  Esteem  Inventory) . 
A  discriminant  analysis  was  used  to  test  these  hypotheses.    A  series 
of  analyses  were  accomplished,  using  the  dependent  variable  as  a 
dichotomous  variable  (pass/fail) .    These  preliminary  analyses  nsrrowed 
the  choice  of  independent  variables  to  be  included  in  the  final 
analysis  to  the  main  effects  only:    GrjaE,  2£»  IE.  and  SEI .  Past 
experiences  in  using  the  I.V.  tests  showed  that  approximately  25  per- 
cent of  the  subjects  completing  this  test  would  fail  it  the  first 
time  administered.    Therefore,  the  PRIORS,  option  in  the  SPSS  program 
was  utilized  to  enter  such  parameters  into  the  analysis.    The  discrim- 
inant analysis  of  the  I.V.  data  yielded  is  shown  in  Table  1.  Wllk's 
Lambda  and  F  ratios  were  calculated  separately  on  each  of  the  four 
independent  variables  to  assess  their  strength  as  discriminators  and 
the  statistical  significance  of  that  strength  (d.f.  -  1  and  157)  is 
shown  in  Table  2.    The  significant  F  ratios  of  Group,  and  SEI  indicate 
that  those  two  vsriablas  separately  may  assist  in  classifying  subjects 
to  one  of  the  categories  of  the  dependent  variable  (pass  or  fail) . 

Further  analysis  of  the  data  yielded  is  shown  in  Table  3.  The 
Standardised  Canonical  Coefficients  of  Group  (.6431)  and  SEI  (-.6222) 
point  to  those  two  variables  as  being  significant  factors  in 
classifying  subjects  to  one  of  the  categories  of  the  dependent  variable. 
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Tabic  1 

Group  Musi  and  Standard  Da  via  t  ions 
Intravenous  Therapy  Variable 


fta>j%aaaa 

v»roup 

DS 

IE 

SEI 

Failad 

(X) 

0.571 

10 . 024 

19  91 A 

(SD) 

0.501 

4.598 

3.695 

9.308 

Passed 

(X) 

0.367 

14.658 

11.692 

37.906 

(SD) 

0.484 

5.323 

3.861 

7.104 

Grand  Mean 

0.421 

15.019 

11.830 

36.981 

(SD) 

0.495 

5.163 

3.804 

7.870 

Table  2 

Testa  of  Significance:    I.V.  by 
Group,  DS,  IS  and  SEI  . 


Variable 

Wilks'  Lambda 

.  F 

Significance 

Group 

0.9668 

5.382 

0.0216 

DS 

0.9863 

'  2.179 

0.1419 

IE 

0.9963 

0.580 

0.4473  * 

SEI 

0.9613 

6.324 

0.0129 
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Table  3 

Discriminant  Analysis  of  Intravenous 
Therapy  Variable 


Variable 

Standardised 
Canonical 
Coefficients 

• 

Pooled 

■ 

Within-C roups 
Correlations 

Group 

* 

0.6341 

-0.7448 

DS 

0.2231 

0.6872 

IE 

-0.0126 

0.4372 

SEI 

-0.6222 

0.2256 

The  Standardised  Canonical  Coefficient  and  Pooled  Within-Groups  Cor- 
relation of  the  variable  Group  reveal  the  significance  of  differing 
instructional  methods  in  this  study.    Table  4  shows  the  direction  of  . 
the  independent  variables 1  relationship  to  the  dependent  variable. 
In  this  analysis  it  is  determined  that  the  students  who  received  the 
instruction  through  lecture  method  were  more  likely  to  fail  the  test 
of  I.V.  content.    Therefore,  Hypothesis  1  was  rejected. 

An  analysis  of  the  combined  variables  on  function  1  (I.V. 
scores)  is  shown  in  Table  5.    The  analysis  in  Table  5  shows  a  signif- 
icant discriminating  power  in  the  four^independent  variables  used  in 
the  analysis.    Although  these  variables  ere  relatively  weak 
discriminators  (Wilks'  Lambda  being  an  inverse  measure  of  the  per- 
centage of  variance  explained  by  the  independent  variables  used  in  the 


592 
•06 


29 


Tabla  4 

Croup  Centroids 

J,wfcX*V#IKH*»  Ltimhrnyy 

Variable 

Group 

Function  1 

Failed 

0.44o9 

Passed 

-0.1604 

Tabic  5 

Canonical  Diecriainant  Function; 
Intravenous  Therapy  Variable 


Function 

Wilks'  Laabda 

Chi-square 

df 

Significance 

1 

0.9323 

10.863 

4 

0.0281 

analysis) ,  their  ability  to  clsssify  subjects  into  correct  groups  is 
statistically  significant.    This  is  confirmed  by  the  classification 
results  shown  in  Table  6.    Table  6  indicates  that  no  cases  were 
predicted  to  fell  in  the  "failed". (0)  category.    The  fact  that  42  of 
the  139  subjects  did  fail  yielded  the  noted  classification  percentage 

The  two  groups  in  this  analysis  set  the  necessary  assumption 
of  honogeneity  on  a  test  of  Equality  of  Group  Covarience  list rices. 

Analysis  of  the  first  and  second  hypotheses  through  the  use 
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Table  6 

Classlf  icatlon  Results 
In t re venous  Therepy 
Variable 


Actual  Group 

Number 

of 
Cases 

Predicted  Group  iiembership 
0  1 

0 

42 

0 

42 

1 

117 

0 

117 

Parcentaga  of  "grouped" 

cases  correctly  classified:  75.47% 

of  discriminant  en* lysis  revealed  e  significant  ability  of  the  variables 

teudsa"  clT1£y  "*}""  *" "  c*"gor7  of  the  i*"aimt 

veriable.    In  this  Alysls  it  may  be  predicted  thet  a  subject  assigned 
to  Group  Oue  (lectu»  is  more  likely  to  fail  the  test  on.  caring  for 
the  patient  receiving  Intravenous  Therapy.    Subjects  with  high  scores 
on  the  SEI  are  more  likely  to  pass  this  test.    Thus,  the  null  hypothesis 
In  Hypothesis  2  was  rejected. 

Although  t~J  scores  of  the  dependent  veriable  in  this  analysis 
make  it  appear  to  be  a  continuous  measure,  these  tests  were  designed 
for  mastery  learning  and  the  students'  ability  to  pass  the,  test  at  the 
70  percent  level  was  the  only  measure  recorded.    Actuel  tests  scores 
were  not  considered  in  this  evaluation.    To  analyse  this  data  as  if 
it  wars  continuous,  a  multiple  regression  analysis  was  accomplished. 
Mo  statistically  significant  findings  ware  obtained.  \ 
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The  third  and  fourth  hypotheses  related  to  the  treatment 
variablea  aa  they  were  uaad  to  present  contant  deteiling  care  of  the 
patient  with  a  Tracheostomy.    The  statistical  treatment  uaad  dictatea 
that  the  third  and  fourth  hypotheses  be  discueeed  simultaneously. 
The  third  hypothesis  tested  was:    "There  are  no  significant 
differences  between  the  performance  of  the  two  treatment  groups  on  a 
cast  of  content  detailing  care  of  the  patient  with  a  Tracheostomy." 
The  fourth  hypothesis  tested  was:    MThere  are  no  significant 
interactions  between  the  perfor^nce  of  the  two  groups  on  tests  of 
content  detailing  care  of  the  patient  with  a  Tracheostomy  and  their 
acores  on  the  DS,  18,  and  SEI."   A  discriminant  analysis  tea ted 
these  hypotheses.    A  series  of  analyses  was  completed,  using  the 
dependent  variable  aa  a  dichotomous  variable  (pass/fail) .  These 
preliminary  analyses  narrowed  the  choice  of  independent  variables  to 
be  included  in  the  final  analysis  to  the  main  effects  (Group.,  DS.  IE. 
and  sjp  and  the  firat  order  interactions  with  Group,.  (GJ8,  GIE,  and 
jSED .    Past  experience  in  using  the  Tracheostomy  test  showed  that  it 
waa  probable  that  approximately  25  percent  of  the  subjects  completing 
this  test  would  fail  it  the  first  time  it  was  administered.  Therefore, 
the  PRIORS  option  in  the  SPSS  program  was  utilised  to  enter  such 
parameters  into  the  analysis. 

The  discriminant  analysis  of  the  Trach  data  yielded  is  shown  in 
Table  7.    It  should  be  noted  thet  the  standard  deviations,  especially 
in  OTS,  GIE,  and  CSEI  are  very  Urge,  in  sons  cases  surpassing  the 
group  means.    Thess  unexpected  standard  deviations  may  have  resulted 
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Table  7 


Group  Means  and  Standard  Deviations 
Tracheostomy  Variable 


Group 


IS 


SIB 


GIB 


GSBI 


Failed 

(X) 

0.316 

14.316 

11.263 

34.632 

4.053 

4.579 

8.843 

(SD) 

0.478 

4.295 

3.429 

.  11.786 

6.249 

7.042 

15.082 

Passed 

(X) 

0.435 

15.114 

11.907 

37.300 

6.750 

5.136 

16.100 

(SD) 

0.498 

5.275 

3.857 

7.180 

"8.335 

6.356 

18.927  ' 

Grand  Means 

0.421 

15.019 

11.830 

36.981 

6.427 

5.069 

15.233 

(SD) 

0.495 

5.163 

3.804 

7.870 

8.145 

6.447 

18.613 

• 
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in  part  from  the  fset  thet  the  two  treatment  grtfups  did  not  prove  to 
be  homogeneous.    On  a  teat  of  Homogeneity  of  Group  Covariance  Matrices 
a  significant  difference  was  revealed  between  the  two  groups.  Thus, 
the  two  groups  did  not  meet  the  assumption  of  statistic*!  equivalence 
postulated  in  the  sampling  procedure.    The  implications  of  this  finding 
will  be  discussed  later  in  this  chapter. 

Wllke*  Lamoda  and  F  ratios  were  calculated  separately  on  each 
of  the  four  Independent  variables  sad  the  three  first  order  interactions 

m  r 

with  Group  to  ansess  their  strength  Individually  ss  discriminators  and 
the  statistics!  significance  of  that  strength  (of  -  1  and  157). 


Table  8 

Tests  of  Significance:    Trach  and 
Independent  Variables 


Vsr  labia 

WOka*  Lambda 

I 

Significance 

Croup 

0.9938 

0.9805 

0.3236 

DS 

0.9975 

0.3987 

0.5287 

IE 

0.9970 

0.4779 

0.4904 

SEI 

0.9879 

1.9350 

0.1662 

CDS 

0.9884 

1.8450 

.  0.1763 

CIE 

0.9992 

0.1241 

0.7251 

CSEI 

0.9839 

2.5690 

0.1110 

An  ?  value  of  3.91  is  required  for  statistical  -significance; 
none  of  the  above  approached  that  level.    Therefore,  none  of  thess 

n 

'598 
611 


54 


■even  variable*  Individually  discriminated  to  the  dependent  variable. - 
further  analyels  of  the  date  yielded  the  following: 

Table  9 

c 

Discriminant  An*  lysis  of  Tracheostomy  Variable 


Variable 


Standardised 
Canonical 
Coefficient 


Pooled 

Wlthln-Groupe 
Correlettlone 


Group 

DS 

IE 

SEI 

GDS 

GIE 

GSEI 


-0.6276 
-0.1453 
0.7347 
0.1388 
1.7573 
-1.9714 
2.1537 


0.2391 
0.1525 
0.1669 
0.3358 
0.3279 
0.0851 
0.3870 


The  Standardised  Canonical  Coefficients  and  Pooled  Wi thin-Groups 

9 

Correlations  of  the  variables  Croup.  SEI.  CDS  and  GSEI  point  to  these 
four  variables  as  being  factors  in  the  classification  of  subjects  to 
the  two  groups  of  the  dependent  variable.    Although  the  Standardised 
Canonical  Coefficient  of  Croup  was  high  (-0.6276) ,  the  Pooled  Within- 
Groups  Correlaeioh  (C.2391)  was  too  low  to  engender  any  confidence  in 
its  ability  to  discriminate  subjects  to  the  dependent  variable. 
Therefore,  Hypothesis  3  was  retained. 
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Tabic  10  Illustrates  tha  direction  of  the  relationship  between 
the  ceteforlee  of  the  dependent  variable  end  tha  discriminating  %- 
independent  variables. 


Table  10 

Group  Cent r© ids  Tracheostomy  Variable 


Group  Function  1 

* 

Fallad  -0.8917 

Faaaed  0.1210 

The  three  independent  varleblea  which  have  shown  significant  strength 
of  discrimination  and  correlation  (SBI.  CDS  and  GSEI)  all  discriminate 
to  the  "passed"  category  of  the  4ependent  variable. 

An  analysis  of  the  group  means  of  the  interaction  variables 
show  the  differences  among  the  two  groups  in  thalr  performance  on  the 
dependent  variable  meesure  is  shown  in  Table  11.    Table  11  shows  a 
considerable  difference  between  the  two  treatment  groups  In  their 
performance  on  the  SEI.    There  la  alao  a  no tic tab Is  difference 
between  the  scores  of  the  "failed"  group  and  the  scores  of  the  "passed" 
group  within  each  treatment  group.    Students  with  high  scores  on  the 
SEI  who  received  this  instruction  through  mediated  self -instruction 
were  more  likely  to  pass  the  achievement  test,  while  students  with 
high  scores  en  the  SEI  who  received  this  instruction  through  a  lecture 
were  more  likely  to  fail  the  achievement  teat.    Conversely,  students 
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Table  XI 

Tracheostomy  Variable 
Group  Means i  Group/SEI 


Kcdleted 
Self-Instruction 

Lecture 

GSEI 

tailed 

8.842 

25.790 

34.632 

(a  -  6) 

Cn  - 

13) 

Cn  -  19) 

Puitd 

16.100 

21.200 

37.300 

Cn  -  61) 

(n  - 

79) 

Cn  -  140) 

Grand  Means 

15.450 

21.849 

36.981 

Ca  -  67) 

(n  - 

92) 

Cn  -  159) 

with  low  scores  on  the  SEX  would  be  expected  to  fall  in  the  mediated 
self -instruction  method  end  pess  in  t*»e  lecture  method  of  instruction. 
Table  12  shove  the  difference  in  the  performance  of  the  two  treatment 
groups  in  their  performance  on  the  DS.    Students  with  high  DS  score* 
who  received  their  instruction  through  mediated  self -instruct ion  were 
more  likely  to  pass  the  achievement  test  while  those  students  with 
high  DS  scores  assigned  to  the  lecture  group  ware  more  likely  to  fall 
the  Tracheostomy  teat.    Conversely,  low  DS  students  in  mediated 
self-instruction  ware  more  likely  to  fail,  while  low  DS  scores  would 
seem  to  predict  success  in  the  lecture  method  of  Instruction. 

Table  13  presents  an  analysis  of  the  combined  variablaa  on 
Function  1  {Tracheostomy  scores); 

•  \ 
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Tafle  12 

Trachcoetoay  Variable 
Group  Means:  Group/DS 
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Kedieted 
Self -Instruction 

"  Lecture 

CDS 

Failad 

4.053 

10.263 

14.316 

* 

(n  -  6) 

<n  -  13) 

<n  -  19) 

Paaaad 

*  6.750 

8.364 

15.114 

(n  -  61) 

(n  -  79) 

<n  -  140) 

Grand  Means 

6.508  ' 
-  (n-67) 

-  8.632 
(n  -  92) 

15.019 
<n  -  159) 

Tabla  3,3 

Canonical  Discriminant  Function 
Tracheostomy  Variable 


— «  

Function 

Wllka*  Lambda 

Chl-square 

df 

Significance 

• 

1 

0.9015 

15.919 

«  % 

7 

O.02S9 

Tabic  13  ihovi  slgnlf leant  dlscrlalaatlng  powtfr  In  the  four  in<Up«nd*at 
variables  and  the  three  first  order  interactions  with  Group,  the 
Standardised  Canonical  Cosff iclenta »  along  with,  their  associated  Pooled 
With In-Gro use  Correlations,  point  to  four  variables  (Croup.  SEX,  CDS 
and  CSEX)  as  contributing  the  greatest  amount  to  the  discriminating 
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•ability  of  Che  total.    Although  theae  varialbes  are  weak  discriminators 
(Wilfci'  Lambda  -  0.9015),  their  ability  to  classify  subjects  into 
correct  groups  Is  statistically  significant.    This  is  confirmed  by 
the  classification  results: 

Table  14 

Classification  Results 
Tracheostomy  Variable, 


Actual  Group 

Number 

Of  j 

Cases  r 

Predicted  Group  Membership 
0  1 

0 

19 

3  16 

1 

140 

3  137 

* 

Percent  of  grouped  cases  correctly  claasified:  88.052 

Table  14  indicates  that 

six  cases  were 

t 

predicted  to  fall  in  the  "failed" 

(0)  category.  In  this  study  19  students  actually  failed,  yielding  a 
claaalf ication  success  percentage  of  88.05Z. 

The  result  of  thin  analysis  is  that  Hypothesis  4  is  rejected. 
Analysis  of  the  data  revealed  a  significant  ability  of  the  four 
independent  variables. and  the  three  first  order  interactions  with 
Group  to  classify  subjects  into  categories  of  the  dependent  variable. 
Particularly  important  discriminators  in  this  analysis  were  the  main 
effect  variable  SEI  and  the  interaction  variables  CDS  and  GSEI. 
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Subjects  with  high  scores  on  the  SEI  were  more  likely  to  pass  the 

Tracheostomy  test.    Those  subjects  with  higher  scores  on  the  DS 

end  SEI  who  were  assigned  to  treatment  group  one  (mediated  self-instruction) 

would  also  be  expected  to  perform  quite  well  on  the  Tracheostomy  test. 

Conversely,  those  students  with  lower  scores  on  the  DS  and  SEI  who 

were  assigned  to  the  lecture  treatment  would  be  expected  to  perform 

leaa  well  on  the  Tracheostomy  teat. 

Although  the  scores  of  the  dependent  variable  in  this 
analysis  make  it  appear* to  be  a  continuous  measure*  these  tests  are 
designed  for  mastery  learning  and  the  students  ability  to  pass  the 
test  at  the  70Z  level  is  all  that  is  recorded.    Actual,  test  scores 
are  not  considered  in  this  evaluation.    To  analyze  the  data  as  if 
it  were  continuous,  a  multiple  regression  analysis  was  accomplished. 


No  statistically  significant  findings  were  obtained. 
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Discussion  of  Findings 

The  following  hypotheses  were  stated  and  tested: 

1*     There  are  no  significant  differences  between 
the  pass/fail  performance  of  the  two  treatment  groups 
on  a  test  of  content  detailing  care  of  the  patient  with 
Intravenous  Therapy* 

2.     There  are  no  significant  distinguishing 
interaction  characteristics  for  those  passing  or  failing 
a  test  of  content  detailing  care  of  the  patient  with 
Intravenous  Therapy  and  their  scores  on  the  Dogmatism 
Scale  (DS),  the  Internal-External  Scale  (IE)  and  the 
Self-Ef ~eem  Inventory  (SEI). 

J.     There  are  no  significant  differences  between 
the  pass/fail  performance  of  the  two  treatment  groups  on 
a  test  of  content  detailing  care  of  the  patient  with  a 
Tracheostomy* 

4.     There  are  no  significant  distinguishing 
interaction  characteristics  for  those  passing  or  failing 
a  test  of  content  detailing  care  of  the  patient  with  a 
Tracheostomy  and  their  scores  on  the  DS,  IE  and  SEI, 

All  four  hypotheses  were  tested  through  a  discrim- 
inant analysis*    In  the  first  hypothesis,  it  was  discovered 
that  within  the  discriminant  analysis  the  method  of 
instruction  was  a  significant  factor  in  classifying 
subjects  to  categories  of  the  dependent  variable.  The 
students  who  learned  through  the  mediated  self -instruct ion 
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method  were  more  likely  to  pass  the  I«V*  test  than  those 
in  the  lecture  group*    This  was  an  unexpected  finding,  as 
many  previous  studies  had  found  no  significant  differences 
in  the  comparison  of  these  two  types  of  instruction. 
Thus,  Hypothesis  1  was  rejected. 

In  the  second  hypothesis,  a  significant  relationship 
was  found  between  students'  performance  and  their  scores 
on  the  Self  Esteem  Inventory.    High  scores  on  the  SEI 
would  seem  to  predispose  the  student  to  higher  achievement 


on  the  test  of  content  detailing  care  of  the  patient 
receiving  Intravenous  Therapy.    However,  no  significant 
distinguishing  interaction  characteristics  were  discovered, 
so  Hypothesis  2  was  retained. 

In  the  third  hypothesis,  a  very  weak  relationship 
was  found  between  instructional  method  and  student 
performance  within  the  discriminant  analysis.    The  low 
correlation  of  this  relationship  caused  Hypothesis  3  to  be 
retained  • 


main  effect  variable,  SEI.  and  the  interaction  variables 


The  two  parallel  studies  described  above  identified 
conflicting  information  as  to  the  effectiveness  of  the  the 


In  the  fourth  hypothesis,  it  was  found  that  the 


GJS  and  GSEIr  were  effective  discriminators  to  the 
Trach  variable .    Thus,  Hypothesis  4  was  rejected. 


Conclusion  ~ 
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two  treatments.    The  analysis  of  data  used  to  test 
Hypothesis  1  found  that  students  assigned  to  the  mediated 
self -instruction  group  performed  significantly  better 
on  a  test  of  I.V.  content  than  did  students  assigned  to 
the  lecture  method.    The  analysis  of  data  used  to  test 
Hypothesis  3  identified  an  advantage  for  the  students 
assigned  to  the  mediated  self -instruction  group.  However, 
this  advantage  was  not  significantly  significant.  This 
was  an  unexpected  result ,  as  the  treatment  groups  were 
identical  and  the  instructional  presentations  were  as 
identical  as  possible  •  The  only  difference  between  the  two 
studies  was  the  topic  of  the  presentation.    The  differing 
results  may  be  attributed  tp  the  variance  of  the  dependent 
variable  (Tracheostomy),  or  may  be  a  result  of  the  lack 
of  homogeneity  of  the  two  sample  groups.    The  conclusion 
one  may  draw  from  this  analysis  is  that  there  may  be 
instances  when  mediated  self -instruction  is  a  more 
effective  method  of  instruction  than  lecture. 

The  analysis  of  Hypothesis  2  and  Hypothesis  4 
revealed  a  main  effect  between  instructional  method  and 
personality  traits.    In  both  analyses  the  BBI  trait 
was  a  significant  discriminator  of  students  to  the 
"pass"  category  of  the  dependent  variable  for  those 
students  who  had  received  their  instruction  through 
the  media.    In  both  instances  students  with  higher  SSI 
scores  were  more  likely  to  pass  the  measures  of  the 
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dependent  variable*    The  analysis  of  Hypothesis  2  revealed 
no  interaction  characteristics  aaong  the  personality 
trait  measures.    In  Hypothesis  4,  the  variables  GPS 
(Group  X  Dogmatism  Scale)  and  GSEI  (Group  X  Self  Esteem 
Inventory)  revealed  an  ability  to  classify  students 
receiving  instruction  through  mediated  self -instruction 
to  the  proper  category  of  the  dependent  variable  Trach. 
Students  assigned  to  Group  *A"  (mediated  self -instruction) 
with  higher  scores  on  the  BS  and  SEI  were  more  likely 
to  pass  the  test  of  Tracheostomy  content  than  those  in 
the  same  group  with  low  DS  and  SEI  scores*    It  is  not 
unexpected  that  'the  interaction  variable  GSEI  should 
be  found  significant,  as  it  is  derived  from  two  main 
effect  variables  found  to  be  significant  in  the  discriminant 
function* 

Less  expected  was  the  significance  of  GDS  (Group  Z 
Dogmatism)  in  the  discriminant  function.  Analyzed 
separately*  the  DS  variable  had  a  negative  weight  and 
a  low  correlation.    However,  when  combined  with  Group 
in  the  interaction  variable  GPS,  the  two  became  a  signifi- 
cant discriminator  in  the  analysis.    Thus,  it  may  be 
supposed  that  the  interaction  of  two  or  more  independent  ' 
variables  can  contribute  to  the  classification  of  subjects 
into  a  category  of  the  dependent  variable. 

The  single  major  conclusion  of  this  study  is  that 
an  analysis  of  the  interactions  between  personality  traits 
and  type  of  instruction  can  assist  the  teacher  in  assigning 
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the  student  to  an  instructional  treatment  resulting 
in  the  greater  likelihood  that  the  learning  will  be 
successful  for  that  student* 
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An  Investigation  of  Technological  Innovation: 
Interactive  Television 
Rhonda  S.  Robinson 

Introduction 

According  to  Curtis  and  Biedertach  (1979,  p. 3),  "Many  critics 
believe  that  education  is  the  only  major  American  industry  which' 
does  not  yet  make  Intensive  use  of  modern  technologies  to  reduce 

a 

its  costs  and  to  Increase  the  scope  of  its  services."   A  project 
begun  In  Illinois  in  August,  1983  is  an  attempt  to  utilize  new  and 
emerging  technologies  to  increase  the  effectiveness  of  the 
educational  process.    This  project,  the  Carrol  Instructional 
Television  Consortium,  was  the  first  cooperative  educational 
program  of  its  kind  in  Illinois,  and  was  born  of  the  common  need  • 
of  four  small  rural  high  schools  to  offer  a  full  range  of  academic 
opportunity  to  their  students. 

The  Consortium  utilises  a  cable  television  network  already 
serving  the  four  districts.    The  system  permits  simultaneous  video 
and  audio  communication  between  any  or  all  of  the  four  high 
schools.    An  Instructor  in  one  of  the  four  schools  teaches  class 
as  they  normally  would,  except  there  are  cameras,  microphones  and 
monitoring  equipment  in  their  classroom.    In  the  other  three 
schools,  students  watch  the  lesson  and  listen  to  the  instructor  on 
their  own  monitors,  while  being  seen  and  heard  by  the  instructor 
as  well  as  by  their  counterparts  in  other  schools.    The  two-way 
television1  consortium  represents  a  technologically  acceptable 
method  for  sharing  instructional  resources,  better  utilising 
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faculty  expertise  and  more  fully  serving  tha  academic  needs  of  the 
students. 

The  project  goals  of  the  Carrol  Instructional  Television 
Consortium  are: 

1.  To  increase  the  total  number  of  course  .off eringsdfvailable  to 
students  enrolled  in  the  participating  districts* 

2.  To  provide  fully  qualified,  experienced,  and  effective  faculty 
to  teach  advanced  level  course  work  in  mathematics,  science 
and  foreign  languages. 

3.  To  motivate  and  challenge  talented  and  gifted  students  through 
association  with  comparable  students  from  other  districts- 

4 .  To  promote  high  levels  of  student  achievement  as  measured  by 
content  mastery  of  advanced  level  course  work. 

5.  To  Increase  the  efficiency  of  teacher  instructional  time  in 
traditionally  low  enrollment  advanced  level  currlcular 
offerings. 

Based  initially  on  these  goals,  project  evaluation  was 
designed  as  a  five  year  process.    The  research  has  broadened  some 
to  include  many  factors  of  the  environment,  and  to  be  as  complete 
as  possible.  ,  * 

Project  evaluation  of  this  scope  has  Inherent  many  problems. 
The  subjectivity  of  observation,  the  lack  of  control  of  population 
or  teaching  methods,  the  gaps  in  communication  or  cooperation  all 
prevented  the  researcher  from  utilizing  experimental  research 
procedures  which  would  add  acre  data  to  the  "U.S. D."  comparative 
studies  literature.    Instead,  the  design  of  this  research  was 
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based  on  naturalistic  research  premises;  the  outcomes  will  be 
non-statistical  but  rich  data  about  the  school  environment  and  the 
project's  success.    This  study  employs  a  naturalistic  paradigm  to 

investigate  a  technologically  innovative  project  using  two-way 

> 

interactive  television  as  a  vehicle  to  enhance  curriculum.  - 

Very  few  projects  involving  interactive  television  have  been 
researched  to  date,  as  the  technology  is  fairly  recent. 
Interactive  projects  In  Trempeauleau  County,  Wisconsin  and  at 
Texas  A  &  M  University  have  resulted  in  some  study  reports  (Hartz, 
1983;  Johnson,  1983)  which  detail  the  utilisation  of  the 
technology  and  its  success.    Project  reports  show  preliminary" 
data,  and  show  no  significant  difference  between  live  and 
interactive  televised  instruction  in  cognitive  growth. 

The  Carroll  I.T.V.  Consortium  modeled  itself  in  part  after 
the  Trempeauleau  County  project.    Evaluation  reports  from 
Wisconsin  were  available  In  the  design  of  the  research  for  this 
project. 

The  previously  listed  Project  Goals  are  the  focus  of  the 
research.    In  order  to  evaluate  whether  the  five  goals  have  been 
achieved,  reseajrch  ob  jw  tiyes  and  da ta  collect  ion  methods .  wejre  . 
directed  at  the  goals  as  well  as  at  more  general  research 
objectives. 
Purpose 

This  paper  explains  the  Carroll  Instructional  Television 
Cot sort turn,  the  design  of  the  research  being  conducted  to  evaluate 
the  project,  and  the  results  evident  f rdm  <Iata  collected  to  date. 
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Object  ivi.s  of  the  Study 

This  study  was  designed  to  determine: 

1.  Is  an  interactive  television  systeii  effective? 

2.  Is  the  teaching/learning  process  affected  by  use  of 
interactive  television? 

3.  Is  the  interactive  television  system  accepted  by  the  teachers. 

4 

the  students,  and  the  school  districts? 

4.  Are  the  project  goals  successfully  met? 
Methodology 

A  case  study  was  designed  to  intensively  study  the  status  and 
interaction  o£— the  participants  and  this  project.    Data  is  being 
collected  using  several  different  techniques: 

1.  Student  cognitive  growth  is  measure  by  pre-  and  post-tesfs  in 
their  subject  matter. 

2.  Students  are  surveyed  four  times  during  the  year  to  evaluate 
technical  aspects  of  the  system. 

3.  Teachers  are  observed  throughout  the  year,  approximately  75 
hours  in  total. 

4.  Administrators  Involved  in  the  innovation  are  interviewed 
about  their  dec  is  ion -making  process  and  their  satisfaction 
with  the  project. 

The  case  study  methodology  inlcudes  many  separate  data 
collection  techniques,  as  listed.    More  specifically,  evaluation 
and  data  cpl lection  includes: 

1.    A  comparison  of  1984-85  course  offerings  Jith  1983-84  course 
offerings  in  each  participating  district  by  the  district 
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administrator  and  researcher . 

t  •* 

2.  Periodic  assessments  of  teacher  effectiveness  by  district 
administrators  and  the  researcher. 

3.  A  survey  of  student  opinion  about  teacher  effectiveness 
conducted  by  the  researcher  during  each  quarter  of  the 
academic  year. 

4.  A  survey  of  student  attitudes  and  satisfaction  conducted  by 
the  researcher  Airing  t^ie  fourth  quarter  of  the  academic  year. 

5.  A  survey  of  teacher  opinions  about  student  motivation  and 
degree  of  challenge  conducted  by  the  researcher  during  the 
fourth  quarter  of  the  academic  year. 

6.  Teacher-made  tests  covering  learner' objectives  identified  in 
course  outlines  utilized  for  entry  and  exit  level  assessments 
of  student  mastery  of  course  content. 

7.  <~  Analyses  of  student  achievement  scores  made  by  the  researcher 

to  assess;    1)  student  &rovth,  and    2)  comparison  of 

achievement  scores  for  students  located  at  originating  site 

« 

with  those  located  at  remote  sites,  and  with  those  not  in  TV 

classes  Where  available. 

*  • 

8.  A  comparison  made  by  district  administrators  of  enrollments  In 

the  televised  classes  with  enrollments  in  the  same  classes 
taught  in  Individual  districts  during  the  previous  two  years. 
Thus,  the  data  collection  has  been  triangulated  to  include 
pre-  and  post-tests,  student/ teacher  surveys,  and  observation  and 
interviews  throughout  the  project.    Cuba  (1981)  suggests  that 
triangulation  can  improve  dependability  and  transferability  of 
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data  collected  in  naturalistic  inquiry.    The  trustworthiness  of 

o  ' 

observation  and  Interview  data  can  be  enhanced  by  the  collect  ion 
of  survey  and  cognitive  growth  data,  and  by  the  comparison  of 
results  gathered  by  all  three  methods. 

Further  explanation  of  each  data  source  should  provide  a 
clearer  understanding  of  the  trlangulatlon  of  data  collection. 

Two  goals  of  the  Carroll  Instructional  Television  Consortium 
were  administrative  in  nature:    to  increase  total  number  of  course 
offerings  in  the  four  schools  and  to  increase  teacher  ? 
instructional  tiro  efficiency.    With  high  school  populations  under 
200,  the  total  number  of  courses  offered  each  year  is  limited. 
Each  administrator  provided  the  number       classes  oflf  ered  per 
school  and  the  teacher  assignments,  and  provided  any  "paper  trail" 
of  course  selection  procedures  and  class  assignments  (meetings 
with  counselors,  teachers,  and  students) .    Thus,  administrator 
Information  documented  the  change  In  total  'number  of  courses 
available  and  in  teacher/ student  ratio  indicating  teacher 
efficiency. 

A  third  goal  of  the  project  was  to  provide  advanced  students 

with  effective,  experienced  teachers.    Seme  schools  had  no 

N 

qualified  foreign  language  or  business  teachfers,  and  Others  had  no 
fully  qualified  advanced  science  teacher.    In  order  to  evaluated 
teacher  effectiveness  over  the  system,  an  observation  instrument 

9 

and  schedule  were  developed.    Teachers  received  five  days  of 

*  # 

in -servic ft -training  prior  to  the  initiation  of  the  system,  end 
discussion  during  those  sessions  was  utilized  to  help  develop  the 
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teacher  observation  instrument.    Also,  materials  from  a  variety  of 
teacher  observation  forms  were  utilized  as  a  guide  to  rating 
effective  teaching  techniques  (Salome, - 1977) .    Elements  of 
teaching  effectiveness  via  television  were  dram  from  reports  of 
T.V.  teaching  studies  (Hartz,  1983)  and  from  observation/  during 
practice  sessions  over  the  system  equipment  itself.  Since 
teachers  were  concerned  about  student  perceptions  of  the  course 
instruction,  especially  the  opinions  of  "distant"  students, 
questions  were  added. to  the  student  survey  dealing  with  content 
presentation  and  teacher  accessibility.    Interviews  with 
administrators  Included  teachef  ef f ectiveness  ratings. 

The  last  two  goals  of  the  project  involved  the  real 
beneficiaries  of  the  system- the  students.    These  goals  were  to 
motivate  and  challenge  talented  students  through  enhanced 
opportunities  to  interact  in  upper  level  courses  with  other 
advanced  students,  and  to  promote  high  levels  of  achievement  among 
these  students.    In  order  to  collect  data  related  to  student, 

motivation,  questions  were  added  to  the  observation  instrument, 

i 

the  student  survey,,  and  all  Interview  instruments.    Pre-  and 
post-tests  were  designed  to  indicate  levels  of  student 

achievement,  and  to  facilitate  comparison  between  Student 

/  • 

achievement,  both  in  televised  and  non-televised  classes  where 

/* 

available,  and  between  on-site  and  "distant91  students  in  any  given 
class.    Pre*  and  post-tests  were  developed  by  jfche  classroom 
teachers,  and  were  often  similar  to  or  the  exact  final  exam  given 
normally  in  the  course.    Teachers  administered  these  exams  during 
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the  first  and  last  week  of  classes  to  all  their  television 
students,  and  to  non-television  classes  where  available. 

To  summarize,  project  goal's  were  used  to  direct  data 
collection  methods.    Where  possible,  triangulated  methods  were 
designed  to  collect  data  using  more  than  one  method.  Observation, 
survey,  and  interview  were  all  selected  to  provide  the  richest 
possible  data  collection  and  to  improve  dependability  and 
transf erabil ty  of  data  collected.    All  instruments  were  developed 
by  the  researcher  ahd  project  participants  utilizing  discussions, 
notes  from  in-service  training,  and  earlier  project  reports  to 
generate  some  elements  of  the  instruments. 
Results 

Results  are  discussed  based  upon  project  goals*  Only 
preliminary  data  is  available,  since  evaluation  will  continue 
throughout  the  initial  five-years  of  the  project.    The  first 
year's  data  has  been  collected  and  partially  analyzed  based  upon 
the  project  goals  and  study  objectives  listed  previously.  Data 
was  collated  from  all  three  sources,  and  the  strength  of  the  data 
across  sources  was  one  area  analyzed.    However,  the  first  year's 
data  is  „  inconclusive  alone,  and  no  statements  as  to  the  project's 
success  should  be  inferred  from  this  preliminary  year. 
Project  €oals: 

A)  Increase  course  offerings  and  teacher  efficiency. 

Each  administrator  reported  the  number  of  course  offerings 
available  to  their  students.    The  largest  school  increased  only  in 
number  of  sections  of  a  course;  no  new  courses  were  added.  The 
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other  three  schools  increased  their  course  offerings  by  one  to 
three  courses  per  school,  with  the  smallest  school  increasing  the 
most.    Teacher  effiency  was  increased  in  each  school. 
Ins  true  tional  time  for  small  classes  (3-6  students)  was  judged  as 
inefficient  in  previous  years.    All  schools  increased  class  sizes 
or  teacher/ student  ratio  by  adding  students  from  the  other  three 
schools  to  the  student  population  "pool"  for  advanced  classes. 

B)  Provide  students  with  effective  teachers. 

Teacher  effectiveness  was  extremely  important  to  the  project. 
Teachers  were  selected  by  their  administrators  based  upon  their 
years  of  experience,  professional  preparation,  personality  or 
teaching  style,  and  willingness  to  participate.  In-service 
activities  focussed  on  mastery  of  the  television  equipment  and 
adaptation  of  lesson  plans  to  television.    Teacher  effectiveness 
in  the  first  year  was  evaluated  bap<?d  upon  observation,  interview, 
and  the  student  survey.    (See  Appendix  I  for  observation 
instrument  and  student  survey.) 

Observation  data  indicated  that  the  teachers  were  effective^ 

\ 

in  managing  the  television  equipment,  materials  distribution,  and 
course  structure  in  their  televised  classes.    Observation  of  each 
teacher  focussed  on  their  use  of  the  system  and  their  teaching 
style,  class  organization,  and  communication  abilities  such  as  eye 
contact,  questioning  and  feedback.    Teachers  were  rated  on  these 
elements,  and  the  ratings  indicated  growths  and  improvement 
throughout  t;he  year. 

The  student  survey  indicated  satisfaction  with  teacher 
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effectiveness  (See  Appendix  2).    On  a  1  *  poor  to  5  ■  excellent 
scale,  teacher  effectiveness  and  accessibility  were  rated  by 
students.     Improvement  was  noted,  especially  in  accessibility 
(from  an  average  of  3.45  in  October  to  4.29  in  April).    Ease  of 
comprehension  of  material  presented  was  rated  an  average  of  3.72 
in  October  and  3.77  in  April,  so  some  improvement  was  noted. 
Teacher  and  student  Interviews  revealed  a  wide  range  of 
satisfaction  with  teacher  effectiveness,  much  of  which  varied  from 
school  to  school  and  resulted  from  technical  systems  operation 
problems  and  student  opinions  of  the  system  rather  than  the 
teacher.    Interview  data  was  the  most  interesting  but  was  also  the 
most  difficult  to  collate,  as  personalities  and  lndivdual  grades 
etc.  affected  the  evaluation  of  effectiveness. 
Teacher  effectiveness  was  perceived  by  all  three  data  sources  to 
be  above  average.    However,  teacher  ef f ectivenss  is  extremely 
difficult  to  evaluate,  and  the  data  has  not  been  completely 
collated. 

C)  Motivate  students  and  promote  high  levels  of  achievement. 

Student  motivation  was  indicated  by  observation  and 
interview.    No  observed  comparisons  to  student  motivation  in 
regular  classrooms  were  available,  but  participants  were  asked  to 
compare  regular  to  televised  classes. 

Motivation  was  indicated  by  participation  and  by  ease  of 
understanding  on  the  student  survey  (Appendix  2)  •    These  two 
elements  averaged  at  3.49  and  3.77  respectively  in  April.  These 
figures  Indicate  that  students  felt  their  participation  was  only 
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average,  but  that  their  comprehension  was  above  average  by  the  end 
*  of  the  school  year. 

Student  achievement  data  was  collected  11  sing  all  three 
methods.    The  pre-  and  post-test  scores  were  somewhat 
inconclusive,  due  to  some  problems  of  administration  and  scoring. 
However,  average  class  "gains"  in  scores  on  the  test  indicated 
that  students  were  learning,  and  that  in  several  classes,  students 

fN. 

in  "distant"  classrooms  improved  more  than  those  in  the  teachers9 
own  school.    Individual  gain  and  average  class  gains  for  each 
class  were  recorded  for  future  comparisons.    In  the  second  year, 
comparisons  with  non-televised  classes  will  also  be  available. 
In  summary,  preliminary  results  have  indicated: 

1.  Student  evaluations  of  technical  considerations  showed  that 
the  system  itself  improved  during  the  first  year; 

2.  Teachers  improved  in  both  effectiveness  and  efficiency 
throughout  the  year; 

3.  Administrators  and  other  faculty  perceptions  showed  increased 
sat isf actio?  with  the  system  in  the  first  year; 

4.  Students  in  remote  interactive  television  classes  achieved  as 
well  on  the  post-test  as  students  in  live  classrooms. 

Discussion/ Summary 

This  research  was  designed  as  a  five  year  case  study,  to 
intensively  analyze  the  status  and  interaction  of  the  project  and 
its  participants.    The  objectives  of  the  study  were  to  determine 
1)  the  effectiveness  of  the  system;    2)  the  effect  of  the  system 
on  the  teaching/learning  process;    3)  the  level  of  acceptance  of 


621 

m 


12 

interactive  technology,  and    4)  the  success  of  the  project. 

The  use  of  naturalistic  inquiry  in  pursuing  these  objectives 
provided  for  the  collection  of  data  in  a  triangulated  design. 
Data  collection  has  proceeded  with  all  three  sources  of  data 
providing  in-depth  and  detailed  results*    Observation  has  proven 
the  richest  source  of  data;  pre-  and  post-tests  were  the  least 
reliable  source  in  the  first  year. 

The  instruments  and  their  method  of  administration  were 
altered  for  the  second  year  of  data  collection.    More  questions 
were  added  to  the  student  survey,  and  the  researchers  had  better 
control  of  the  testing  process*    These  changes  should  improve  the 
caality  and  quantity  of  data  collection* 

Naturalistic  Inquiry  is  a  process,  not  a  static  technique* 
Research  utilizing  multiple  data  collection  techniques  including 
observation  has  particular  strengths  and  weaknesses*    As  a 
methodology,  naturalistic  inquiry  will  not  definitively  prove  that 
this  sytem  is  more  effective  than  a  live  teacher,  or  that 
interactive  television  is  better  than  or  less  effective  than  other 
instructional  delivery  systems*    The  cognitive  growth  of 
individual  students  measured  using  more  sytematlc  methods  would  be 
more  quantifiable. 

The  advantage  of  this  inquiry  technique  is  that  it  is  a 
process.    Much  is  learned  during  the  data  collection  about  the 

m 

techniques  employed.    The  quantity  and  detail  of  data  collected  is 
extraordinary,  and  the  possibilities  for  collating  and  reporting 
are  challenging.    The  study  herein  describe  should  provide 
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reliable,  detailed  data  addressing  the  four  objectives*  The 
richness  of  the  data  will  provide  even  more  than  is  required  for 
the  continuation  of  the  project,  and  will  certainly  establish,  th 
level  of  success  of  the  project  relating  to  its  five  project 
goals. 
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Appendix  I 
Part  I 


MEMORANDUM 

TO:         TV  Students  -  Chadvick,  Lanark,  Milledgeville  and  Shannon 

DATE!      May,  1984 

RE:         Evaluation  of  system  - 

Now  that  the  television  system  has  been  operational  for  close  to  a  year  we  would 
appreciate  an  evaluation  of  your  experience  taking  a  course  via  this  method. 

Please  rate  on  a  scale  of  1-5 

(1  m  poor,  2  -  below  average,  3  »  average,  4  -  above  average,  5  ■  excellent) 

Make  additional  comments  you  care  to. 

,  4 

Course:    Instructor: 


Tour  school: 


1.    Was  the  reception  of  the  picture  good  enough  for  following  the 
copying  materials*  etc? 


l^ture, 


  (1-5) 

2,    Was  the  audio  satisfactory? 

(1-5) 


3a    Do  you  feel  that  the  talkback  feature  allowed  you  to  participate  effectively 
in  the  class? 


(1-5) 


4«    Was  the  instructor  accessible  to  you  outside  of  regular  class  time? 

  (1-5) 


5a    Have  you  been  receiving  hand -out 8 t  and  other  materials  form  the  instructor 
in  time  for  assignments? 


0-5) 


6«    The  material  presented  in  this  class  has  been  as  easy  to  follow  as  material 
presented  in  regular  face-to-face  classes? 

_  *   (1-5) 

7.    Additional  comments. 
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Part  2 

Evaluation  of  Teaching  t'ur  f<um.mn'  ovor  Interactive  Television 


3** 


I  rum  what  site 


Class  originates 
Data 


Section  1  -  Equipment  (system)  evaluation 

Low  Blph 

1.  Is  starting  class  a  problem  because  of  12      3      4  5 
equipment  set-up. 

3 

2.  Does  the  teacher  run  an  audio  and  video  I       2      3      4  5 
check  before  class. 


3.  Are  there  problems  with  audio?  Yes  No 

4.  if  yes,  please  describe. 


E valuator 

Teacher 

Class 


5.    Are  there  problems  with  video?  Yes  No 

t>.    If  yes*  please  describe  those  problems. 


7.  Does  the  teacher  make  effective  use  of  the  1      2      3      4  5 
special  effects  generator  (SEO). 

8.  How  could  the  teacher  make  better  use  of  the  SEG? 


■  BEST  COPY  AVAILABLE 
$40 


«     rv-  .  Low  l!ip,h 

Does  IT  appear  any  part  of  the  system  is  J       2       3      4  5 

Interfering  with  the  teach  lug/ 1  earn  itt<|  process • 

10,    P  tease  dl scribe  how  the  system  is  interfering 

with  the  teaching/ learning  process  11  uppiicable. 


11.  Does  It  appear  the  students  are  reluctant  12      3      4  5 
to  participate  in  class  because  of  the  system? 

12.  Are  the  students  capable  of  "troubleshooting"      I      2      3      4  5 
the  system?     -      -  ■  •■   

13.  If  not,  what  a  re  some  of  the  i>rol»lenr..  f  Ihj 
students  are  encountering,  arid  at  wluit  site? 


Section  2  -  Instructional  style 

How  does  the  teacher  come  across  on  the  system. 

M.    Personal  traits    -  projects  tack,  patience,  1 
freedom  from  mannerisms,  etc. 

15.    Voice  -  clearness,  decisiveness,  I 
pleasantness 

ly*    Language  usage  -  oral  LrnjliJi,  1 
/      handwriting,  spelling 

Content  skills 

17.  Knowledge  of  subject,  knowledne  of  field,  1 
ability  to  develop  Ideas. 

18.  Planning  learning  activities  -  development  1 
of  objectives  in  terms  of  pupils  growth  in 
knowledge  and  understanding  of  subject* 

19.  Teaching  techniques  -organization  of  subject  1 
matter,  stimulation  of  student  learning. 

BEST  COPY  AVAILABLE 


2  3  4  5 

2  3  4  5 

2  3  4  V 

2  3  4  5 

2  3  4  5 

2  3  4  5 


•* 

Low  Hip.h 

20. 

Presentation  skills  •  rocognil ien  of 

1       2       3  4 

5 

individual  differences,  variety  of 

techniques,  clarity. 

Did 

the  Instructor  use  good  per^HMl  t«jchni.|tK". 

for: 

21. 

gaining  and  holding  attention 

12       3  4 

5 

22. 

questioning 

12       3  4 

5 

23- 

reinforcing 

12       3  4 

5 

9 

Clarifying  ano  »?xpiainin«j 

12      3  4 

5 

25. 

giving, direct  ions 

1        2        3  4 

2b. 

use  of  student  ideas 

12       3  4 

5 

27. 

physical  (eyes,  voice,  language. 

12       3  4 

5 

lack  of  tension,  enthusiasm,  movement > 

28* 

Did  the  Instruction  fit  the  time 

constraints. 

12       3  4 

5 

29. 

Were  there  clearly  defined  object ivou. 

12       3  4 

5 

3J. 

Mere  the  objectives  neet? 

#12      3  4 

5 

31. 

Was  there  effective  closure? 

12      3  4 

5 

Section  3  -  Misc..   

32. 

Does  it  appear  the  teacher  is  available 

to  work  with  the  students  after  class? 

12       3  4 

5 

33. 

Did  the  Instructor  use  supplemental 

materials?  ' 

12       3  4 

5 

34. 

Did  the  instructor  allow  students  to 

12      3  4 

/ 

participate  in  class? 

5 

35. 

Is  too  much  time  being  spent  on  record 

{ 

keeping? 

1       2      3  4 

5 

36. 

Does  teacher  take  time  to  explain  complex 

concepts? 

1       2      3  4 

5 

'  628 
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BEST  COPY  AVAILABLE 

•4* 

37.  How  long  was  this  class  (In  minutes) 

38.  Approximately  how  much  dead  time  i&  there? 
(no  Instruct ion  before,  during  and  after 
class). 

39.  Were  there  unusual  or  creative. touches 
which  caused  the  teacher  to  stand  out? 


40.   Other  comments. 


o 
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BEST  COP^  WMUBLE 


4  ,  Ovcral  I-Siiinniary 

10/25/83         *  '  ^ 

1.  Was  the  reception  of  the  picture  good  enough  for  following  the  lecture* 
copying  materials,  etc.?      .'  3.9  . 

2.  Was  the  audio  satisfactory?         3. 1        -  , 

3.  Do  you  feel  that  the  talkback  feature  allowed  you  to  participate  effectively 
in  the  class?  3.8 

4.  Was  the  instructor  accessible  to  you  outside  of  regular  class  time?  3.1* 

5.  Have  you  been  receiving  hand-outs,  and  other  materials  from  the  Instructor 
in  time  for  assignments?  4.4 

6.  The  material  presented  In  this  class  has  been  as  easy  to  follow  as  material 
presented  in  regular  face-to- face  classes.  3.9 

Comments: 

In  general,  the  majority  of  the  students  enjoyed  and  found  the  class*  interest- 
ing; allowing  them  to  experience  a  broader  curriculum. 

f 

The;  most  common  of  negative  feedback  vas  that  there  are  problems  jtith  the 
audio  and  picture  reception  at  times. 

Other  comment*  included;  the  need  for  another  Spanish  educated  person,  other 
than  the  instructor,  in  the  class  and  that  the  program  should  be  used  for  smaller 
classes  with  approximately  eight  students  at  the  maximum. 


BEST  COPY  AVAILABLE 
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Overall -Summary  \  % 
(Teacher  Present) 
10/25/83 

1.  Was  the  reception  of  the  picture  Rood  enough  for  following  the  lecture, 
copying  materials,  etc,?    '     3.  7 

2.  Was  the  audio  satisfactory?         3, 3 

■ 

3«    Do  you  reel  that  the  talkback  feature  allowed  you  to  participate  effectively 
in  the  class?  3,3 

A.    Was  the  instructor  accessible  to  you  outside  of  regular  class  time?  4T4 

5.  Have  you  been  receiving  hand-outs,  and  other  materials  from  the  instructor 
in  time  for  assignments?        A. 3 

6.  The  material  presented  in  this  class  has  been  as  easy  to  follow  as  material 
presented  in  regular  face-to-face  classes.  3.5 
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645 


Ovcral  1-Sununary 
(No  Teacher  Present) 
10/25/83 


Was  the  reception  of  the  picture  good  enough  for  following  lecture, 
copying  materials v  etc.?  4.1 

Was  the  audio  satisfactory?  3. 1 

Do  you  feel  that  the  talkback  feature  allowed  you  to  participate  effectively 

in  the  class?  U.3 

—  


Was  the  instructor  accessible  to  you  outside  of  regular  class  time?  3.^ 

Have  you  been  receiving  hand-out:  s,  and  other  materials  from  the  Instructor 
in  time  for  assignments?  4.4 

The  material  presented  in  this  class  has  been  as  easy  to  follow  as  material 
presented  in  regular  face- to- face  classes.  4. 1 
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Appendix  I 
Part  3 

CARROLL  INSTRUCTIONAL  TELEVISION  CONSORTIUM 

Student  Survey 
1984  -  35 

Your  School       ,  __        Old  you  take  a  TV  course 

;  last  year? 


Instructor 
Course 


□  Yes 

□  No 


Please  rate  the  following  questions  on  a  scale  of  1  -  5  (l*poor,  2=below 
average,  3«average,  4-above  average,  5-excellent),  and  make  any 
additional  comments  you  care  to. 

1.  What  was  your  opinion  of  the  TV  classes  before  this  class? 

o  no  opinion    □  poor  Idea    □  average  Idea  □  above  average  Idea 

2.  Why  did  you  have  that  opinion?   


3.  Was  the  reception  of  the  picture  good -enough  for  following  the 

lecture,  copying  materials,  and  taking  notes?   (1-5) 

4.  Can  you  hear  the  Instructor,  and  the  students  1n  the  other 

schools?   (1-5) 

5.  Do  you  feel  that  the  talkback  feature  allowed  you  to 
participate  as  effectively  1n  this  class  as  In  regular 

classes?   (1-5) 

6.  Do  you  feel  as  comfortable  learning  from  the  TV  teacher 

as  you  do  from  a  teacher  1n  a  regular  class?   {1-5) 

7.  Is  the  teacher  accessible  to  you  outside  of  regular  class 

time?  \   (i-5) 

Please  describe  when  and  how  the  teacher  1s  accessible  to  you. 


8.  Do  you  feel  you  have  an  opportunity  to  get  to  know  your 
classmates  from  the  other  schools  as  well  as  you  get  to 

know  your  classmates  1n  a  regular  class?  ^  (1-5) 

9.  Have  you  been  receiving  hand-outs  and  other  materials 

from  the  teacher  in  time  for  assignments?   (1-5) 


Over  please 

eric  $47  633 


10.  Do  you  feel  the  material  presented  in  this  class  has  been 

as  easy  to  follow  as  material  presented  in  regular  classes?   (1-5) 

11.  How  well  do  you  like  the  TV  class?  (1-5) 

12.  In  general,  how  well  do  you  like  school?   (1-5) 

Are  there  any  additional  comments  you  would  like  to  make? 


Thank  you  for  your  time  and  effort. 
Please  return  this  survey  to  your  teacher. 


J 
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Appendix  II 


STUDENT  FEEDBACK/ ASSESSMENT 


An  evaluation  of  the  television  system  was  administered  to  participating 
students  3  times  during  the  academic  year  (1983-84).    Each  time  they 
were  asked  to  respond  to  6  questions  concerning  logistical  and  technical 
considerations  of  the  system.    Using  a  scale  of  1  -  5  {l=poor,  b=excellent) 
they  were  asked  to  rank  each  question.   The  following  are  the  questions 
and  their  corresponding  results. 

Question  #1 

Was  the  reception  of  the  picture  good  enough  for  following  the  lecture, 
copying  materials,  etc.? 

October  February  April 

3.85  3.59  3.70 

Question  §Z 

Was  the  audio  satisfactory? 

3.13  3.20  3.49 

Question  #3 

Do  you  feel  that  the  talkback  feature  allowed  you  to  participate 
effectively  in  the  class? 

3.67  3.35  •  3.49 

Question  #4 

Was  the  instructor  accessible  to  you  outside  of  regular  class  time? 
3.45  3.58  4.29 

Question  #5 

Have  you  been  receiving  hand-outs,  and  other  materials  from  the 
instructor  in  time  for  assignments? 

4.24  4.29  4.69 

Question  #6 

The  material  presented  in  this  class  has  been  as  easy  to  follow  as 
material  presented  in  regular  face-to-face  classes? 

3.72  3.46  3.77 
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A  RHETORICAL  AND  STRUCTURAL  ANALYSIS 
OF    INSTRUCTIONAL  TELEVISION 

by 

ANUNCIACION  M.  SALCEDO 
University  of  Wisconsin 
Madison ,  Wisconsin 


Introduction 

As  an  area  of  instruction*    social  studies  has  been 
considered  unsatisfactory.    The  amount  of  time  spent  in 
teaching  social  studies  is  far  less  compared  with  reading 
and  mathematics  (Department  of  Public  Instruction,  1982), 
social  studies  lack  uniformity  and  predictability  (Superka, 
Havke  and  Morrissett,  1980),  and  teachers  use  textbooks 
most  of  which  are  well  over  five  years  old  as  their  bases 
for  reading,  discussion  and  evaluation  (Shaver,  Davies  and 
Helburn,  1979).    With  the  ever  present  textbook  in  the 
classroom,  the  most  extensively  used  instructional  practices 
in  social  studies  are  lecture  and  discussion  (  Superka, 
Hawke  and  Morrissett,  1980). 

Given  the  state  of  social  studies  teaching  across  the 
United  States,  the  Wisconsin  Department  of  Public  Instruction 
(or  DPI)  conducted  a  survey  to  identify  the  needs  of  social 
studies  teachers  in  Wisconsin.    Among  other  things,  this 
survey  identified  the  need  for  an  in- school  television 
resoource  series  for  middle  schools.    It  was  on  the  basis  of 
this  expressed  need  that  the  Wisconsin  Educational 
Television  Network  and  the  Agency  of  Instructional 
Television  (AIT)  funded  planning  and  production  of  a  world 
culture  series.    This  world  culture  series  subsequently 
called  ACROSS  CULTURES, was  the  subject  of  this  study. 

In  the  area  of  global  education,  teachers  can  use 
television  to  help  students  develop  inferences  about  the 
concept  of  culture.    However,    reading  a  television  on 
world  cultui^s  from  a  geographical  and  cultural  distance 
can  be  problematic.    The  possibility  of  "domesticating" 
foreign  cultures  is  real  because  what  is  alien  tends  to  be 
translated  into  the  familiar.    Is  it  possible  to  understand 
the  meaning  of  a  television  presnetation  on  foreign  cultures 
as  contexted  in  its  own  terms? 

The  use  of  a  television  documentary  to  help  teach 
concepts  of  world  cultures  is  new.    ACROSS  CULTURES  is  a 
pioneering  effort  in  this  regard.    It  would  be  instructive 
to  find  out  if  the  communicators  of  ACROSS  CULTURES 
achieved  their  objectives  and  to  analyze  the  methods  used  to 
to  communicate  intended  concepts. 
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Statement  of  the  Problem 


ACROSS  CULTURES  was  produced  in  res  pens  g  to  the  need 
of  social  studies  teachers  for  a  television  series  that 
cover  world  culture  topics.    What  were  the  stated  objectives 
of  the  communicators  of  ACROSS  CULTURES?    How  was  ACROSS 
CULTURES  structured  to  attain  these  objectives?  This 
study,  attempted  to  address  these  questions. 


Related  Literature 

From  its  very  inception ,  cinema  can  be  seen  as 
divided  into  two  main  categories  which  remain  essentially 
the  same  even  today:  the  realistic  film  or  the  documentary 
and  the  fiction  film. (Levin,  1971).    The  documentary 
supposedly  uses  conventions  of  objectivity,  respect  for 
the  material  and  a  sense  of  real  life.    Objectivity  in  the 
documentary  however,  is  problematic.    Does  the  real  world 
exist  as  an  objective  fact  we  can  look  at  or  is  it 
something  that  is  constructed  by    people  through  their 
intelligence,  labor  and  imagination  or  is  it  a 
combination  of  all  of  these?    Row  do  we  use  the  art  to 
express  the  meaning    of  the  real  world?    Williams  (1980) 
philisophizes  that  as  yet,  we  have  no  overarching  theory 
which  deals  convincingly  with  all  the  factors  that  make 
the  real  world  and  its  expression  on  film  and  their 
relations    with  each  other.    Along  this  vein,  Bluem  (1968) 
and  Sandall  (1974)  claim  that  the  processes  of  selection 
and  arrangement  which  take  place  during  perception  and 
transmission  are  fundamental  to  both  the  artistic 
(subjective)  and  the  journalistic  (objective)  communication 
of  the  document aty. 

Historically,    the  documentary  has  drawn  much  from 
the  working  procedures  and  validation  techniques  of 
anthropology.     Indeed  the  documentary  is  replete  with 
ideological  and  cultural  codes.  When  a  film  maker  from  ' 
one  culture  makes  a  film  on  another  culture,  there  is 
bound  to  be  poor  communication  and  a  clash  of  codes 
(Gabriel,  1982).    Several  researchers  (  Eco,  1977; 
Sontag,  1982;  McDougall,  1974?  Mead,  1974)  have 
docummented  the  difficulties  outsiders  encounter  when 
they  tr<j     to  capture  on  film  cultural  expressions. 

The  history  of  the  documentary  in  theory  and 
practice,  is  interpretative  and  socially  oriented.  The 
Griersonian  do  cumentary  which  used  direct  address  was 
overwhelmingly  didactic  and  presumptuously  authoritative 
(Lovell  and  Hillier,  1974).    Another  style,  the 
documentary  which  used  indirect  address  rejected  the 
viewer  supossedly  capturing  reality.    However,  this 
transparency  was  rejected    as  an  effect  produced  in  and 
upon  a  system  of  signs  and  codes  where  signs  were  used 
as  the  equivalent  of  commentaries  (Nichols,  1978;  Harpole, 
1980;  Hanson,  1977). 
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1980*    Hanson,  1977).    Subsequent  documentaries  which 
incorporated  direct  address  into  footage  by  using  interviews 
were  not  much  different;  the  voice  of  the  text  took  the 
form  of  characters  directly  speaking  to  the  audience. 
Interview-footage  documentaries  were  really  not  very 
different  from  the  authoritative  direct  address  documentaries: 
interviews  were  used  to  support  footage  with  out  the  footage 
itself  being  questioned.    Nichols  (1983)  proposes  a 
major  documentary  style-  the  self-reflexive  documentary 
as  one  which  possesses  a  textual  system  that  asserts  its 
own  voice  in  contrast  to  the  voices  it  observes  and 
recruits.    Direct  and  indirect  address  are  mixed  using 
observation  and  exposition  to  arrive  at  a  dual  level  of 
reference,  that  of  evidence  and  argument.    Bellman  and 
Jules-Rossette  (1977)  did  a  study  along  a  similar  vein, 
they  claim  that  they  are  just  beginning  to  discover  the 
scope  and  Importance  of  perspectival  variations  and  the 
influence  of  the  immediate  social  context  upon  the 
structuring  accounts. 

The  documentary  is  socially  oriented  and  aimed  at 
social  and  political  change.    Rhetorical  communication 
aims  at  persuasion  and  if  the  documentary  is  accepted  to 
be  a  form  of  rhetorical  communication,  then  it  can  be 
scrutinized  rhetorically.    Along  this  this  line  of 
reasoning,  winters  (1963)  analyzed  a  documentary,  THE  RTVER 
using  Burke, s  (1951)  rhetorical  format.    He  attempted  to 
find  out  whether  the  communicators  of  THE  RIVER  achieved 
their  objectives  by  analyzing  their  purposes,  the  setting, 
agents  and  strategies.  Winters*  analysis  of  the  strategies 
used  in  THE  RIVER    focused  on  the  content;  he .concluded 
that    the  communicators  of  THE  RIVER  used  familiar  names  , 
contrast  and  problem  solution    as  techniques  of  persuasion. 

One  way  of  determining  the  effectiveness  of  the 
strategies  used  to  attain  objectives  is  by  subjecting  the 
text  to  a  structural  analysis.  The  assumption  is  that 
meaning  is  a  function  not  only  of  content  but  also  of 
form.     Images  donjt  speak  for  themselves,  the  role  of 
technique,  form  and  style  highlight  an  instance  of 
construction  (Nichols,  1983).     In  the  text  of  the 
documentary,  one  can  trace  out  a  scheme  of  reference  which 
presides  over  the  formation  of  the  message  (Bettetini,  1973). 
Therefore,  a  study  of  the  structure  of  the  documentary 
yields  insights  in£o  the  manner  -in  which  the  maker 
interprets  the  objects  of  the  documentary  which  in  turn 
can  be  related  to  the  attainment  or  non- attainment  of 
stated  objectives. 

Procedure 

The  purpose  of  this  study  was  to  find  out  if  the 
communicators  of  ACROSS  CULTURES  attained  their  objectives 
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and  to  find  out     how    ACROSS  CULTURES  was  structured  to 
attain  stated  objectives.    ACROSS  CULTURES  is  a  videotape 
series  on  world  cultures  designed  to  compliment  sixth  and 
seventh  grade  social  studies  textbooks.    It  is  presented 
in  a  documentary  format.    The  series  is  composed  of 
thirteen  15-minute  programs  about  three  widely  divergent 
cultures  in  three  continents:  Osakana  in  urban  Osaka, 
Japan;  the  isolated  Tarahumara  in  the  sierra  Madre 
mountains  of  Mexico?  and  the  Baoule  river  people  in  the 
village  of  Yrakrou  near  the  capital  city  of  Abidjan,  ivory 
Coast.  The  theme  of  the  series  is  that  of  maintaining  peace 
in  the  world  by  respecting  cultural  differences.  The 
first  three  programs  introduce  the  three  cultural  groups , 
the  next  seven  programs  describe  the  institutions  within 
these  three  cultures  and  the  final  three  programs  describe  their 
linkages  with  the  world. 

Two  methods  of  analysis  were  used:  a  rhetorical 
analysis  of  the  documentary  and  another,  a  semiotic 
analysis  of  the  text.    Rhetorical  analysis  was  done  using 
a  modified  version  of  Burke's  (1951)  rhetorical  format. 
It  attempted  to  answer  the  questions:  what  was  done,  when 
and  where  it  was  done,  why  it  was  done  and  who  did  it. 
The  semiotic  analysis  of  the  text  examined  three  structural 
devices  namely:  time,  edits  and  forms  of  address  which 
included  narration  and  focal  distance  of  the  camera. 

Time  was  defined  as  the  total  and  average  amount  of 
time  devoted  to  each  culture  within  each  program  and 
across  programs  4  to  13.    The  first  three  programs  were 
excluded  because  these  were  introductory  programs  portraying 
exclusively  one  culture  in  each  program. 

Two  forms  of  address  were  analyzed.  These  were 
narration  and  focal  distance  of  the  camera.    These  were 
considered  forms  of  address  because  they  implied  a 
position  for  viewing.    For  this  analysis,  three  programs 
were  systematically  chosen  from  Programs  4-13  to 
constitute  the  sample.  The  sample  programs  were  Programs 
5  (  The  Environment),  9    (Sports,  Society  and  Self)  and 
13  (Choices  for  the  Future). 

To  quantify  narration,  the  following  steps  were  taken: 
1)  shots  portraying,  each  culture  were  identified  and 
counted.    A  shot  was  defined  as  constituting  visual  images 
between  edits,  the  uninterrupted  flow  of  images  that  the  . 
camera  shot  at  one  point  in  time.  2)  Narration  in  these 
shots  were  classified  as  synchronized  (on-camera)  or  non- 
synchronized  (voice-over).  3)  The  frequency  of  on-camera 
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and  voice-over  narration  in  all  shots  for  each  culture 
were  determined. 

Analysis  of  focal  distance  was  done  by  1)  Defining  the 
ranges  of  the  distance  of  the  object  to  the  camera  using 
Becker's  (1983)  definition. 

Long  shot  <LS)  -  full  shot  of  an  entire  area 
Medium  long  shot  Oils)  -  shot  of  entire  body,  long  distance 
Medium  shot  (MS)    -  shot  of  one  or  more  persons,  waist  up 
Medium  close-up  (MCU )    -  shot  of  a  person,  shoulders  up 
Close-up  (CD )    -  shot  showing  detail 

2) Determining  the  frequencies  of  each  of  the  range  of  focal 
distance  in  all  shots  devoted  to  ea~h  culture  in  the  sample 
'  programs .These  frequencies  were  used  to  describe  treatment 
of  the  three  cultures. 

The  third  structural  device  that  was  examined  was  edits. 
Edits  were  classified  as  either    cuts  or  fades.    A  cut  was 
defined  as  a  switch  from  an  image  to  another  (Monaco, 1981, 
p.  427).    A  fade  was  defined  as  the  gradual  dissappearance 
of  the  image  onscreen  and  the  gradual  appearance  of  another- 
The  frequencies  with  which  fades  or  cuts  were  used  for  each 
culture  in  the  sample  programs  were  determined.  These 
frequencies  were  compared  and  used  to  describe  the  structure 
Of  ACROSS  CULTURES. 

Findings 

The  Rhetorical  Analysis 

A  series  of  national  studies  identified  issues  in 
social  studies  education  which  need  to  be  addressed  in 
Wisconsin  in  the  1980' s.    On  this  basis,  the  WETN 
conducted  a  survey.  Among  other  things,  this  survey  identified 
the  need  for  an  in- school  television  resource  series  for 
sixth  and  seventh  grade  social  studies.  WETN  in  consultation 
with  DPI  formed  a  committee  to  specify  goals  and  content 
for  the  series.    The  committee  was  composed  of  six  members 
who  possessed  theoretical  and  pedagogical  expertise.  ■ 

# 

ACROSS  CULTURES  has  two  major  objectives:  1)  to 
help  students  understand  the  concept  of  culture,  and 
2)  to  encourage  students  to  become  familiar  with  and 
appreciate  the  broad  range  of  cultures  in  the  globally 
shared  culture  (WETN,  1983,  p.  106). 

ACROSS  CULTURES  was  produced  by  .John  Robbins  of 
Positive  Image  Productions  (PIP)  and  Peter  Codmbes  of  the 
Academy  of  Research,  instruction  and  Educational  Systems 
(AR$ES).     John  Robbins  is  an  expert  with  extensive  local 
and  international  documentary  malting  experience.  The 
producers  went  on  a  reconnaisance  trip  using  the  content 
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outline  made  by  the  content  committee  as  a  guide*  This 
content  outline  which  was  subsequently  uued  as  the  guide  for 
on- location  taping  was  revised  on  the  basis  of  reconnaisance 
results.  It  should  be  pointed  out  though* that  final  decision 
on  the  revisions  were  made  by  only  two  of  the  content  committee 
members*  in  a  sense  reflecting  their  own  synthesis. 

ACROSS  CULTURES  was  produced  at  the  cost  of  $367,000. 
WETN  provided  $150,000.    Various  agencies  across  the  United 
States  and  Canada  provided  $179,180.    AIT  provided  the  rest 
through  sales  of  the  series  to  state  and  provincial  agencies 
(DeRose,  1983). 

Planning  and  production  of  ACROSS  CULTURES  took  place 
between  1981  and  1983.  The  series  which  is  available  only 
on  videotape,  began  broadcasting  in  January  1984. 

The  Structural  Analysis 

The  analysis  of  the  text  indicates  a  favorable 
portrayal  of  the  Japanese.    Their  time  on  screen  is  longest 

when  compared  to  the  Tarahumara  and  the  Baoule.  (See  Table,  3JU~  

within  the  time  they  are  portrayed,  positive  aspects  of  their 
culture  are  emphasized.    Camerawork  is  similarly  used,  close-ups 
portray  Japanese  flexibility  in  adopting  western  technology 
(especially  in  Program  13- -Future  Choices ")  .    Among  the 
Tarahumara,  close-ups  are  used  to  emphasize  their  dirty 
environment  (Program  5  "The    Environment" )    and  their  gambling 
habits  in  the  only  thing  they  excel  in-  running  (Program  9- 
"Sports,  society  and  Liesure").    The  Baoule  are  treated 
somewhat  impersonally,  they  are  shown  at  a  distance,  mostly 
with  medium  long  and  long  shots    (Table  2).    Throughout  the 
series,    narration  is  presumptuously  authoritative.  The 
narrator  appears  in  sync  in  the  beginning  shots  of  the 
segments  for  each  culture  to  present  the  thesis  of  his 
exposition.    Supporting  evidences  are  mounted  in  subsequent 
voice-over  narration,  this  narration  sets  in  place  bits  of 
argumentation  that  the  image  track  illustrates  with  redundancy. 
(Table  3). 

Data  in  Table  4  shows  that  the  shots  portraying  the  Baoule  and 
Tarahumara  were  joined  mostly  with  cuts.  Fades  were  used 
mostly  as  a  transition  device,  a  segue  from  one  segment  to 
another.    This  was  not  the  case  with  the  Japanese.    There  were 
almost  as  many  fades  as  there  were  cuts  between  shots.  This 
could  reflect  careful  editing  but  it  can  also  reflect  positive 
treatment  where  the  negative  aspects  are  shown  in  rapid  cuts, 
for  example  the  scenes  on  the  tragedies  like  earthquakes 
and  fire  were  shown  in  less  than  five  seconds  as  if  to  diminish 
its  importance/significance. 

Conclusions 

ACROSS  CULTURES  conveys  the  concepts  of  culture  and 
cultural  interdependence.    It  familiarizes  the  students 
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Table  /     Time  (in  seconds)  devoted  to  each  Culture  in  Programs  4-13  of  the  "Across 

Cultures "  Videotape  Series 

Program  Number        Introduction       CULTURE    Credits    Total  Time 

J apanese  Tarahumara  Baoule 
(Mexico)  (Ivory 

Coast)  * 


4  (Providing  Fami-  51  267 
ly  Needs) 

"5  (Environment)  51  229 

6  (  Religion)  53  318 

7  (Passing  on  51  353 

Traditions ) 

8  (Education)  51  312 . 

9  (Sports.  Socie-  51  274 

ty  and  Self) 

10  (Communication )  51  426 

11  (Cultural  Exchange)  51  407 

12  (Cultural  Change)  51  380 

13  (Choices  for  51  342 

the  future) 

TOTAL  3300 
A  V  E  K  A  G  7  330 


♦non-specific  to  a  culture 


203  282  46      849+51*=  900 

(15  mins) 


380 

194 

46 

900 

(15  mins) 

219 

266 

46 

900 

(15  mins) 

204 

238 

54 

900 

(15  mins) 

164 

319 

54 

900 

(15  mins) 

341 

170 

54 

900 

(15  mins) 

175 

194 

54 

900 

(15  mins) 

239 

149 

54 

900 

(15  mins) 

295 

120 

54 

900 

(15  mins) 

224 

176 

54 

847 +5 3*  =»  900 

(15  mins) 

2444  2108 
244.4  210.8 


-  Hiatance  range  in  all  shots  of  segments  by 

Table  5     Frequency  ofuserf  ^^J^S"!-  Thirteen 


Program  5 
(Environment) 

Program  9 
{ sports,  society 
and  self) 

program  13 
(Choices  for 
the  Future) 

TOTAL 


h  T  U  R  -  v 
"Tarahumara  Baouie 


c  u 

Japanese  —  — 

LS  MLS  MS'MCU  CU      LS  MLS  MS  MOJ  CO      LS  MLS  MS  MOT  OJ 

^        *        «  jh  ^        1  14  1  est 

15    -      2    2      9  8^ 
13    2      3    -  - 


8  -  5  2  10  62  11- 
17  *3    10    2  .13        7    2      6      3  5 


8    -    11    2    16        l  21    11  - 


l'21    11      -  * 


35    2    16    4    25    25    25    26    4    26      13  25  18 


4  9 
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Table  3.    Frequency,  of  narration  in  shots  by  culture, 
Programs  5,  9  and  13  . 


c  u 


V 


E 


Program 


Tarahuroara  Baoule 
On-    Voice-       On-  Voice- 
camera     over    camera  .  over    camera  over 


Japanese 
On-  Voice 


5  (Environ*- 

ment)  3 

9 ( Sports , So- 
ciety &  Self)  - 

13 (Choices  for 
the  Future)  2 

TOTAL  5 


23 

18 

34 
77 


3 
2 


22 
43 

21 
.86 


18 

21 
56 


Table  4.    Frequency  of  edits,  all  shots  by  culture,  Programs 
5,  9  and  13 


u 


Japanese 
Cut  "Fade 


U 


R 


E 


Tar ahum ar a  Baoole 
Cut      Fade    *  Cut  Fade 


Program 

5 ( Environment ) 


8  18 


9  (Sports, Society 

and  Self  12  6 

13 (Choices  for 

the  Future)      28  8 


20 


43 


5 
2 


TOTAL 


48  32 


15.  6 
75  13 


6  4 


18  5 

13  8 
37  17 


o 

EMC 
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with  the  three  cultures    which  are  presented  as  examples 
of  the  wide  range  of  diverse  cultures  in  the  world.  The 
manner  of  portrayal  encourages  the  students  to  appreciate 
the  Japanese  culture*  one- which  is  similar,  at  least 
technologically,  to  the  west*    However,  the  portrayal  of 
the  Tarahumara  (Mexican)  and  the  BadUle  (ivorian) 
works  against  the  development  of  appreciation  for  these 
cultures*    Hie  series  is  structured  so  that  the  audience 
identifies  with  and  appreciate  the  Japanese  but  it  is 
prescriptive  of  the  Tarahumara  presenting  western 
technology  as  solutions  to  their  problems*  The  series 
implies  urbanization  and  foreign  trade  as  inevitable/ 
desirable  future  choices  for  the  Baoule.  A  videotape 
which  aims  to  help  students  develop  appreciation  does 
not  ofler  prescriptions. 

ACROSS  CULTURES  is  replete  with  ideological  and 
cultural  codes.    It  illustrates  the  problems  of  realistically 
portraying  cultures  from  the  outside.  ACROSS  CULTURES  does  \ 
not  present  the  "truth"  from  "fact*"  because  the  objective 
and  neutral  videoist  does  not  exist-    The  implications  of 
this  study  are:    1)    There  is  a  need  for  closer  cooperation 
between  those  \/ho  decide  the  content  of  instructional 
materials  such  as  a  documentary,  and  the  producer  because 
the  actualization  on  tape  of  the  intentions  of  the  content 
committee  is  mediated  by  the  producer.  The  gaps  between 
intended  and  actual  portrayal  of  the  three  cultures  in 
ACROSS  CULTURES  vera  inevitable  given  the  instructional 
design  used.  2)    It  is  hignly  desirable  to  incorporate 
the  participants '  perceptions  of  their  activities 
which  are  portrayed  on  tape  even  if  they  have  to  be 
trained,  i  "  3)  Given  the  constraints  of  the  documentary 
process,  it  is  imperative  that  the  viewers" >be*  made  aware 
of  the  conditions  under  which  the  documentary  was 
produced  so  that  they  can  make  their  own  conclusions, 
and  4)  A  rhetorical    study  of  the  documentary  can  aid 
in  the  development    of  a  "rhetoric  of  the  documentary 
film  or  videotape"  in  much  the  same  way  ad  Aristotle's 
Rhetoric  has  the  scholar  of    oral  discourse.  Such 
rhetoric  which    should  include  analysis  of  both  content 
and  form  could  reveal  the  manner  in  which  the  documentary 
can  be  designed  to  achieve  stated  objectives 
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Using  Microcomputers  for  Drill  and  Practice: 

Issues  and  Implications* 

David  F.  Salisbury 
Florida  State  university 

Use  of  the  microcomputer  as  a  means  to  provide  practice  drills  U 
learners  Is  regarded  by  some  as  not  being  a  creative  use  of  the 
computer.  Computer  programs  are  often  criticized  for  containing  too 
much  drill  and  practice.  Apparently,  some  people  feel  that  It  1s  a 
shame  to  use  a  marvelous  device  like  the  computer  for  "mere"  drill  and 
practice,  when  It  could  be  used  for  seemingly  more  creative  activities. 

In  her  recently  published  book,  Helm  (1984)  pointed  out  the  Irony 
Involved  1n  criticism  by  teachers  of  computer-based  drill  and  practice. 
It  would  seem  that  teachers  would  welcome  a  tool  to  provide 
Individualized  practice  to  students  beyond  what  they  themselves  are 
able  to  provide.   Teachers  do  not  typically  enjoy  conducting  drill  and 
practice  routines  and  using  the  computer  to  provide  this  essential 
activity  could  conceivable  free  up  teacher  time  to  spend  In  developing 
student's  higher  order  cognitive  skills. 

Part  of  the  reason  for  the  negative  view  of  computer-based  drill 
and  practice  1s  probably  due  to  the  desire  of  teachers  to  pursue 
seemingly  more  exciting  Intellectual  activities,  therefore,  any  drill 
and  practice  program,  no  matter  how  well  designed  or  sophisticated  Is 
viewed  as  undesirable.  Much  of  the  negativism,  however,  1s  undoubtedly 
due  to  the  problem  of  the  quality  of  the  drill  and  practice  software 
currently  In  the  schools.   Many  computer  drill  and  practice  programs 

,  Presented  at  the  annual  meeting  of  the  Association  for  Educational 
Communl cations  and  Technology,  January  1985,  Anaheim,  CA. 

^Bl  648 


are  admittedly  dry,  boring,  and  unpleasant  and  often  Ignore  some  of  the 
most  basic  principles  derived  from  research  In  learning  psychology* 
However,  these  bad  examples  should  not  cause  us  to  underestimate 
potential  value  of  computer-based  drill  and  practice.  Practice  does  not 
have  to  be  dry  and  unpleasant.   Many  kinds  of  arrangements  can  be  made 
to  make  drill  and  practice  an  Interesting  activity. 

This  paper  describes  some  of  the  Issues  and  Implications  related  to 
using  the  microcomputer  as  a  means  to  provide  practice  activities.  Also 
described  are  two  drill  and  practice  programs  which  exemplify  a  higher 
quality  and  sophistication  of  computer-based  practice  strategies. 
Finally,  the  paper  describes  a  program  of  research  being  conducted  at 
Florida  State  University  to  Identify  effective  and  efficient  computer- 
based  drill  and  practice  Instructional  strategies. 

Automatldty  of  Subskllls 

Recent  research  1n  modern  cognitive  learning  1s  suggesting  that 
drill  and  practice  may  be  more  Important  than  many  people  realize.  The 
research  that  suggests  this  is  related  to  the  area  of  automatldty  of 
subskllls.  Automatldty  refers  to  the  state  at  which  a  skill  ceases  to 
consume  much  of  the  attentlonal  capacity  of  the  brain.  Usually,  an 
automatized  skill  can  be  performed  simultaneously  with  other  tasks 
without  Interfering  with  the  performance  of  those  tasks.   Examples  of 
skills  which  have  become  automatic  to  some  people  are  skills  such  as 
typing,  discriminating  numbers  from  letters,  or  decoding  common 
words. 

Research  Is  suggesting  that  In  order  for  learners  to  perform 
complex  skills  such  as  reading,  computer  programming,  or  mathematical 
problem  solving,  many  of  the  subprocesses  Involved  have  to  have  become 
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automatic  to  the  learner.  The  Implications  of  this  research  are  that 
certain  basic  procedures  which  later  become  subprocedures  to  higher 
order  skills  ought  to  be  not  simply  nastered,  but  brought  to  a  state  of 
autotaatldty. 

As  far  as  we  know  at  the  present  tine,  the  only  way  a  skill 
becomes  automatic  Is  through  an  extensive  amount  of  practice,  usually 
extending  over  a  long  period  of  time.  Because  It  U  difficult  for 
teachers  or  trainer  to  provide  sufficient  practice  to  assure  that  all 
students  automatize  Important  subskllls,  many  prominent  researchers  are 
looking  to  the  computer  as  a  means  to  more  efficiently  provide  the  type 
and  amount  of  practice  necessary  to  produce  automatlclty  (e.g.  Gagne, 
1982;  Lesgold,  1983).   However,  these  researcher  have  pointed  out  that 
computer  drills  which  will  effectively  help  learners  automatize  skills 
will  probably  need  to  be  more  sophisticated  and  better  designed  that 
the  typical  drill  and  practice  programs  currently  available  for 
microcomputers. 

The  concept  of  automatldty  also  Implies  that  1n  addition  to  accuracy 

-- 

of  performance,  speed,  and  the  ability  to  perform  the  skill  without 
interfering  with  a  secondary  task  are  Important  criteria  for 
determining  mastery  (Resnlck  A  Ford,  1981,  chap.  2).   Also  Implied  1s 
the  Idea  that  performance  could  profitably  be  evaluated  and  remediated 
In  terms  of  "bugs"  In  subsklll  performance.   Brown  and  Burton  (1978) 
have  demonstrated  that  all  errors  computed  by  students  are  not  random 
errors,  but  many  times  are  an  Indication  of  a  bug  or  a  bug  combination 
In  one  of  more  of  the  subprocesses. 

In  the  context  of  using  the  computer  as  a  tool  for  helping 
students  automatize  skills  several  Issues  arise: 

I.     Which  skills  should  be  automatized? 
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2.     What  needs  to  be  done  to  sake  certain  that  a  skill  has 

attained  the  staius  of  automatlclty? 
t     3.     When  should  practice  be  given  and  how  much  practice  should  be 

given?  " 
4.     What  kind  of  data  should  be  collected  on  Individual  student 

practice  performance  and  how  should  that  data  be  used? 

>  « 

Which  Skills  Should  be  Autoatatlzed? 

Skills  which  need  to  be  automatized  are  those  which  have  to  be 
carried  out  by  the  student  simultaneously  with  other  skills  or,  as  part 
of  a  higher  level,  sore  complex  skill.   We  know  from  the  work  of  such 
researchers  as  Schneider  A  Schtffrln  (1977),  Lesgold  &  Resnlck  (1982), 
and  Beck,  Perfettl,  &  McKeown  (1982)  that  many  of  the  basic  component 
skills  of  reading  and  math  need  to  be  automatized.   It  Is  obvious  that 
efficient  computer  programmers,  typists  and  musicians  have  all 
automatized  many  of  the  subprocesses  which  constitute  their  respective 
skills.   At  this  point  we  do  not  have  any  way  of  determining  whether  a 
skill  needs  to  become  automatic  other  than  looking  at  a  person  who 
performs  the  higher  level  skill  and  trying  to  determine  which  subskllls 
that  person  performs  automatically.  Task  analysis  (breaking  down  a 
skill  Into  Us  component  parts)  should  be  used  as  a  tool  for  helping  us 
determine  the  subskllls  Involved  In  performance  of  a  higher-order  skill. 

What  Needs  to  Be  Done  to  Make  Certain  That  a  Skill  Has  Attained  the 
Status  of  Automatlclty? 

Automatlcity  1s  a  fairly  new  concept  and  ways  to  measure  It  are 
still  forthcoming.  At  the  present  time  we  might  establish  the  policy 
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of  Including  speed  and  the  ability  to  perform  the  skill  simultaneously 
with  some  other  skill  as  criteria  for  mastery. 

In  order  to  accomplish  this,  practice  drills  could  be  devised  to 
Include  three  stages.   The  first  stage  Mould  concentrate  on  helping  the 
student  learn  to  perform  the  skill  accurately.   In  the  second  stage 
speeded  practice  would  be  Introduced  until  performance  Is  both  fast  and 
accurate.  In  the  third  stage,  a  competing  task  or  game  would  be 
Introduced  which  the  student  would  have  to  attend  to  while  performing 
the  original  task.   What  we  are  working  for  Is  performance  which  Is  not 
only  fast  and  accurate,  but  fast,  accurate,  and  automatic. 

When  Should  Practice  be  Given  and  How  Much  l£  Heeded? 

There  1s  much  evidence  In  the  literature  to  suggest  that  short, 
spaced  periods  of  practice  give  better  results  than  long  concentrated 
practice  sessions  (see  Anderson,  1980).  This  spacing  effect  has 
repeatedly  been  shown  with  many  types  of  material.   If  the  computer  Is 
to  be  used  as  a  tool  for  developing  automatldty  It  will  have  to  be 
Integrated  Into  the  curriculum  In  such  a  way  that  students  can  space 
practice  of  a  skill  over  a  period  of  time  In  a  systematic  manner.  Some 
computer  drills  are  designed  to  be  completed  by  the  learner  In  one 
sitting.    If  the  learner  stops  the  drill  and  resumes  1t  later,  the 
learner  1s  required  to  practice  on  the  same  Items  In  the  same  sequence 
'        as  before,  which  Is  not  a  good  practice  strategy. 

In  order  to  produce  automatldty,  what  1s  needed  are  computer 
programs  which  Include  the  capability  of  allowing  the  learner  to  stop 
and  resume  practice  sessions  without  starting  at  the  lowest  difficulty 
level  of  the  skill  or  with  the  same  Items  as  before.   In  some  cases, 
this  can  be  done  by  dividing  the  content  Into  difficulty  levels  and 
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al lowing  the  learner  to  specify  the  appropriate  difficulty  level  for 
each  practice  session.   In  other  cases,  this  mist  be  (tone  by  having  the 
computer  kee>  a  record  of  each  Individual  learner's  performance  on  the 
drill.  This  requires  that  the  learner  sign  on  to  the  drill  by  name  and 
date  so  that  at  the  beginning  of  each  new  practice  session,  the 
computer  can  retrieve  the  Individual  record  for  that  learner. 

Because  autonatldty  requires  that  a  skill  be  overl earned  and  used 
over  a  long  period  of  time,  computer  drills  should  be  designed  to  be 
"practice  and  review"  drills  rather  than  simply  practice  drills.  Once 
an  Item  or  piece  of  material  has  been  learned,  a  mechanism  should  be 
provided  to  reintroduce  that  Hem  or  material  systematically  for 
review.  This  can  be  done  by  setting  Up  a  series  of  review  stages 
allowing  mastered  Items  to  be  reviewed  at  different  stages,  say  after  a 
day,  then  again  after  a  week,  then  after  a  month. 

Another  way  to  approach  this  might  be  '*  provide  "Increasing-ratio 
review"  where  the  amount  of  review  material  Increases  and  the  amount  of 
new  material  decreases  as  more  material  is  covered.   When  the  student 
first  begins  the  drill,  all  the  Items  are  new  Items.  As  the  student 
masters  Items,  these  become  review  Items  and  are  reintroduced 
systematically  Into  the  drill.   Eventually  most  of  the  Items  the  student 
will  be  working  with  will  be  review  Items. 

As  you  can  see,  using  the  microcomputer  In  this  way  would  require 
an  Integration  Into  the  classroom  or  training  curriculum  that  1s 
different  from  the  typical  adjunct  use  of  the  microcomputer  1n  the 
classroom. 
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What  Kind  of  Data  Shduld  be  Collected  oh  Individual  Student  Performance 
and  How  Should  That  Data  be  Used? 

Computer  drills  could  be  categorized  as  being  of  two  types: 
Intelligent  and  non-intelligent.   Intelligent  drills  would  be  those 
which  continuously  collect  data  on  student  perfonaance  'luring  the  drill 
and  use  that  data  to  Modify  presentation  of  the  drill  on  an  1  test-by- 

e 

Hen  basis.  Non-Intel  11  gent  drills  would  be  those  which  do  not  collect 
student  performance  data  and  which  present  the  same  Items  to  each 
learner  In  the  sane  sequence  each  time. 

Using  a  learner's  response  history  to  make  Instructional  decisions 
and  alter  the  remaining  Instructional  sequence  requires  the  continuous 
collection  of  student  perfonaance  data.  P  also  requires  the  use  of 
mathematical  models  to  specify  optimal  sequencing  schemes.  In 
designing  an  Intelligent  computer  drill  the  question  arises  of  what 
data  to  collect  and  how  to  use  that  data'  to  alter  the  sequence  of 
Instruction.  Atkinson  (1974)  has  shown  how  the  principles  derived  fron 
what  1s  referred  to  1n  the  literature  of  mathematics  and  engineering  as 

optimal  control  theory,  or  simple  control  theory  can  be  used  to 

#■ 

optimize  the  instructional  sequence  for  a  particular  learner.-  The  type 
of  data  which  typically  has  to  be  collected  Includes  what  Items  have 
received  correct  responses,  how  many  Intervening  Items  have  been  seen, 
and,  for  review  purposes,  how  long  of  a  time  period  has  elapsed  since- 
an  Item  was  seen.  The  two  computer  drill  strategies  described  later  1n 
this  paper  demonstrate  different  approaches  to  utilizing  student 
performance  data  to  modify  the  Instructional  presentation. 
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Two  Good  Drill  and  Practice  Strategies 

The  Corrective  Feedback  Paradlg 

The  Corrective  Feedback  Paradigm  (CFP)  Is  a  drill  and  practice 
strategy  which  could  be  used  to  present  drills  on  paired-associate 
tasks  such  as  Medical  terminology,  chealcals  and  their  abbreviations, 
English  and  foreign  language  vocabulary,  etc.   As  opposed  to  the  type  of 
drill  which  could  be  done  by  hand  with  flashcards,  the  CFP  adds  several 
features  only  available  In  a  computerized  drill.  Each  of  these  are 
discussed  briefly  below. 

Specialized  Feedback.   In  learning  paired-associated  Items,  two 
types  of  errors  are  possible:    1)  out-of-llst  errors  (giving  a  response 
which  Is  not  an  answer  to  another  Item  In  the  11st),  2)  discrimination 
errors  (giving  a  response  which  1s  an  answer  to  another  Item  In  the 
drill  list).    In  the  CFP,  the  type  of  feedback  provided  to  the  learner 
Is  a  function  of  £he  type  of  mistake  made.   If  the  learner  makes  an  out- 
of-llst  error,  the  correct  answer  is  provided;  for  a  discrimination 
error,  the  feedback  tells  the  learner  what  stimulus  the  student 
responded  to  as  well  as  the  answer  to  the  stimulus  that  was  actually 
provided. 

Discrimination  Training.  After  committing  a  discrimination  error, 
the  student  1s  given  a  discrimination  training  sequence.   This  Involves 
presenting  the  Item  missed  and  the  Item  with  which  1t  was  confused. 
The  student  must  be  able  to  respond  correctly  to  Wh  stimuli  before 
returning  to  the  drill. 

Spaced  Review.  After  the  student  makes  a  mistake,  the  missed  Item 
reappears  according  to  a  spaced  review  schedule  determined  by  the 
designer  who  may  specify  up  to  three  review  positions.  For  example,  a 
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nlssed  Item  might  appear  after  2  intervening  items,  then  again  after  6 
more  Items,  then  a  third  tine  after  10  more  Iteas.  At  any  stage  during 
the  review  cycle  an  Incorrect  response  on  a  review  Item  reinitializes 
the  review  sequence  for  that  Iten. 

Retirement  Criterion.  Items  are  retained  In  the  drill  until  the 
student  responds  correctly  to  an  Item  a  specified  number  of  times  In  a 
row.  This  number  can  be  set  by  the  designer  of  the  drill.  As  Items  are 
retired  from  the  drill  the  number  of  Items  the  student  Is  working  with 
decreases  until  all  items  have  been  retired. 

Because  the  CFP  1s  a  drill  template  designed  to  accommodate 
various  content,  all  of  the  features  of  the  CFP--feedback  messages, 
spacing  of  the  review,  and  retirement  criterion  can  be  set  and 
manipulated  by  the  designer.   The  CFP  Is  available  on  the  PLATO 
Instructional  computing  system  and  has  been  used  to  construct  drills  In 
various  content  areas.  Comparisons  of  the  CFP  with  othefl drill 
paradigms  show  that  the  CFP  Is  a  more  effective  means  of  providing 

t 

training  in  these  types  of  skills  than  what  could  Be  done  by  hand 
without  using  a  computer  (Selgal  &  Missel t,  1984). 

\ 

The  Progressive  State  Paradigm 

The  Progressive  State  Paradigm  Is  a  sophisticated  drill  strategy 
which  uses  a  student's  response  history  to  alter  the  remaining 
instruction  In  order  to  optimize  the  learning  process  for  that  student. 
This  1s  done  by  presenting  Items  1n  six  exercise  formats.  Optimization 
of  the  drill  Involves  (tedding  which  Items  to  present,  which  exercise 
formats  to  present  them  In,  and  when  to  schedule  review.  This  requires 
a  complete  response  history  for  each  student  and  use  of  this  history  to 
make  trial -by-trial  decisions  regarding  which  items  to  present  next. 


Figure  1  presents  a  flowchart  (adapted  from  Atkinson*  1974) 
shoving  the  structure  of  the  drill  and  the  various  exercise  f onsets. 
When  a  student  begins  a  practice  session,  any  Items  left  In  his  or  her 
working  pool  from  the  last  session  are  transferred  fro   die  disk  to  the 
current  working  pool.   If  the  working  pool  Is  not  full,  then  additional 
Items  are  selected  fron  the  review  pool  If  there  are  any  Items  which 
have  a  review  date  less  than  or  equal  to  today's  date;  otherwise 
additional  Items  are  selected  from  the  new  Itea  pool/  The  working  poo^ 
Is  then  shuffled  and  the  first  Item  Is  selected  from  the  working  pool 
,  and  Its  state  Identified.  The  Itea  selected  may  he  shown  to  the 
learner  In  any  one  of  six  states.   If  the  Item  has  just  entered  the 
working  pool  for  the  first  time,  It  will  be  presented  as  a  pretest  Item 
(state  1).    If  the  learner  responds  correctly  to  the  Item,  It  will  be 
deleted  from  the  system.  Otherwise,  Its  state  will  be  update©"  to  state 
2.   The  value  of  the  item  counter  (N)  1s  then  Incremented,  and  the 
second  Item  from  the  working  pool  Is  selected.  This  Item  Is  presented 
In  accordance  with  Its  specified  state.  Note  that  after  an  Item  Is 
presented  In  state  3,  It  Is  removed  from  the  working  pool  and 
transferred  to  the  review  pool,   after  all  Items  1n  the  working  pool 
have  been  presented  once  (N  >  7),  the  working  pool  1s  replenished  and 
shuffled,  and  the  Item  counter  (N)  Is  set  back  to  1.    This  process  1s 
repeated  until  the  student  terminates  the  practice  session. 

When  an  Hern  Is  presented  1n  the  Rehearsal  state  (state  2),  the 
stimulus  and  corresponding  response  ore  presented  to  the. learner 
simultaneously  to 'allow  the  learner  to  associate  them- together.  The 
learner  Is  then  asked  to  merely  enter  a  copy  of  the  correct  response. 
In  the  Drill  state  (state  3),  only  the  stimulus  Is  presented,  and  the 


10 

657 


eric  673 


learner  1s  asked  to  enter  the  correct  response.   If*  the  Item  has  been 
answered  correctly  a  sufficient  number  of  times  to  pass  the  specified 
criterion*  then  It  1s  transferred  to  the  review  pool.  The  review  date 
1s  set  for  the  appropriate  date  (generally  the  next  day). 

During  any  of  the  Review  states  (states,  4,  5,  and  6),  only  tne  - 
stimulus  1s  presented,  and  the  learner  1s  asked  to  enter  the  correct 
response.  This  Is  Identical  to  how  the  Item  Is  presented  1n  the  Drill 
state.   When  an  Item  has  been  answered  correctly  to  the  criterion  level 
set  for  the  specific  Review  state,  It  1s  removed  from  the  working  pool 
and  transferred  back  to  the  Review  pool  with  a  new  review  date. 

All  of  the  criterion  settings  which  determine  when  to  move  an  Hem 
from  one  state  to  the  next  as  well  as  the  other  features  of  the 
Progressive  State  Paradigm  (number  of  Hems  1n  working  pool,  spacing 
between  reviews,  etc.)  can  be  manipulated  by  the  designer  to  fit  the 
nature  of  the  application  and  ability  level  of  the  students.  - 

Current  Research  at  Florida  State  University 

At  Florida  State  University  we  are  currently  engaged  1n  three 
programs  of  research  which  relate  to  the  design  of  computer-based  drill 
and  practice. instructional  strategies.   The  first  program  of  research 
related  to  this  area  seeks  toNdentlfy  guidelines  for  designing 
practice  drills  by  drawing  from  the  basic  sciences  of  behavioral. and 

— 

cognitive  psychology.  Currently,  we  are  attempting  to  Integrate  the 
findings  of  this  literature  review  Into  a  model  or  aid  for  designing 
computer-based  practice  strategies. 

The  second  research  program  attempts  to  empirically  verify  the 
prescriptions  and  recommendations  for  designing  practice  derived  from 
the  work  described  rfeove.   In  this  investigation,  microcomputer 
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technology  1s  used  to  deliver  different  practice  strategies  In  order  to 
test  the  relative  effects  of  these  strategies  on  learning.  This 
program  also  Involves  the  evaluation  of  commercially  available  drill 
and  practice  programs  for  microcomputers  1n  order  to  categorize  them  as 
to  effectiveness  and  to  evaluate  the  degree  to  which  they  Incorporate 
the  recommendations  derived  from  the  literature. 

In  a  third  project,  the  ability  to  use  the  computer  to  develop 
subsMIl  automatic tty  1s  being  explored.  This  project  deals  with 
development  of  skills  necessary  to  efficiently  solve  mathematical  word 
problems.  Theorists  have  proposed  that  in  order  to  solve  math  word 
problems  learners  must  develop  skills  1n  several  related  subsklll 
areas,  the  most  Important  of  which  are  keyword  recognition,  problem 
type  recognition,  goal  Identification,  diagramming,  basic  computation, 
and  answer  estimation.  As  part  of  this  project,  computer-based 
training  Involving  sophisticated  drill  and  practice  strategies  Is  being 
developed  to  produce  automatlclty  In  these  skills.  This  program  1s 
serving  to  provide  a  unique  laboratory  for  investigating  the  role  and 
effectiveness  of  various  instructional  strategy  paraneters  In  producing 

0 

automatldty.  It  1s  hoped  that  these  Investigations  will  provide 
validated  guidelines  for  the  development  of  efficient,  and  effective 
computer-based  drill  and  practice  Instructional  programs. 
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The  Relationship  Between 
Teacher  Burnout  and  Media  Utilization 

7 

The  purpose  of  this  study  was  to  assess  the  relationship  between 

teacher  burnout  and, the  use  of  various  media  in  teaching.    Data  were 

t  0 

collected  from  schoolteachers  in  the  Fott  Worth,  Texas  public  school 
"system,  and  analyzed,  in  an  attempt  to  answer  the  quest ion t    Do  teachers 
who  are  low  in  burnout  use  certain  me^ia  materials  more  frequently 
than  do  teachers  who  are  on  the  other  end  of  the  burnout  spectrum? 

In  the  past  decade,  researchers  have  reported  ttfat  workers  in 
the  human  service  field  have  been  susceptible  to,  what  has  been  termed, 
the  "burnout  syndrome"  (Chemise,  1980b).'    According  to  Maslach  and 
Jackson  (1981),  persons  in  the  "helping  professions,"  such  as  teaching, 
frequently  exhibit  negative  attitudes  towards  their  clients,  as  well 
as  tend  to  evaluate  their  own  work  negatively.    In  addition,  many 
workers  report  that  they  are  emotionally  and  physically  exhausted, 
due  to  an  inability  to  cope  positively  with  high  job-related  stress 
(Pines     Maslach,  1978).    Burnout,  in  general,  can  be  defined  as  "a 
syndrome  of  inappropriate  attitudes  towards  clients  and  towards  self, 
often  associated  with  uncomfortable  physical  and  emotional  symptoms 
ranging  from  exhaustion  and  insomnia  to  migraine  and  ulcer,"  as  well 
as  with  "deterioration  of  performance"  (Kahn,  1978,  p.  61). 

"Teacher\umout"  can  be  defined,  more  specifically,  as  a  negative 
pattern  of  responding  to  stressful  teaching  events,  to  students,  *nd 
-  to  teaching  as  a  career,  as  well  as  a  perception  that  there  is  a  lack 
of  administrative  support.    The  inability  to  cope  with  teaching  problems 
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and  wfth  uncooperative  students  in  a  constructive  manner  (Pratt,  1978), 
and  the  failure  of  supervisory  personnel,  to  provide  positive  leadership 
,  (Cook,  1979)'  have  been  cited  as  factors  that  are  associated  with  low 

t  teacher  morale  and  teacher  burnout. 

i 

Teaching,  at  all  levels  of  the  educational  ays tea,  can  be  a  stressful 
experience.    Researchers  have  stated  that  a  certain  proportion  of 
teachers  become  dissatisfied  with  their  jobs,  and  eventually  burn 
out  (Bioch,  1977s  Truch,  1980;  Weiskopf,  1980).    A  survey,  by  the 
National  Education  Association,  found  that  35X  of  public  schoolteachers 
were  dissatisfied  with  their  current  teaching  jobs,  and  (of  that  group), 
almost  9%  were  highly  dissatisfied  ("NEA  Survey,"  1980).    More  than 
two- fifths  (41X)  of  the  teachers  polled  in  the  1983  NEA  Survey  expressed 
doubts  that  they  would  become  teachers  again,  if  they  had  the  chance 
to  start  over  ("Given  a  Second  Chance,"  1983).    Certainly,  job  dis- 
satisfaction and  burnout  have  contributed  to  high  rates  of  teacher 
absenteeism  and  turnover,  as  well  as  to  low  school  morale  (Cunningham, 
1982).    Burnout  is  contagious.    When  dissatisfied  and  depressed  teachers 

are  present  in  a  school,  others  can  be  infected  with  the  "disease," 
/ 

in  which  negativism,  lethargy  and  despair  are  symptoms.     In  a  short 
period  of  time,  the  entire  organization  can  become  a  dispirited  place 
(Freudenberger,  1977). 

While  some  school  teachers  cope  well  with  job-related  stress, 
others  do  not  (for  a  variety  ©^reasons,  both  personal  and  organizational). 
It  has  been  suggested  that  teachers  who  have  had  an  adequate  professional 
preparation,  and  who  have  been  encouraged  and  supported  in  their  efforts 
to  do  a  good  job  are  less  prone  to  burn  out  (Spaniol  &  Caputo,  1980). 
Therefore,  teachers  who  report  that  their  efforts  are  supported  by 
their  administrators,         have  had  a  good  media-utilization  component 
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in  th^ir  preservice  and/or  inservice  training  programs,  and  who  are 
not  enetvated  by  the  burnout  syndrome  should  be  more  likely  to  use 
media  in  their  teaching.  « 

Of,  course,  there  are  many  reasons  (technological,  administrative/ 
Institutional,  economic,  and  personal)  why  teachers  do  not  eiaploy 

media  (Gill^t,  1973;  Rose,  1982).    Gillet  (1973)  suggested  that  weariness 

s 

(associated  with  burnout)  and  laziness  were  factors  in  the  failure 
to  utilize  media.    Rose  41992)  believed  that  educators  resist  using 
instructional  technologies  due,  in  part,  to  the  lack  of  motivation 
"to  adapt  course  content  to  the  technology,  to  manipulate  the  equipment, 
and/or  to  prepare  software"  (p.  12).    One  aspect  of  burnout  is  the 
feeling  that  the  job  and  the  clients  are  not  worth  the  effort.  An 
extremely  burned-out  individual  is  more  likely  to  cope  with  job-related 
stress  with  expressions  of  anger,  sadness  and/or  depression,  not  by 
trying  harder.     Burnout  is  characterized  by  a  lack  of  enthusiasm  and 
excitement  by  workers  ( Cherries,  1980a).    The  regular  use  of  many 

9 

(though  probably  not  all)  media  requires  son^  motivation  and  exertion 
of  effort,  as  well  as  positive  administrative  support. 

This  study  investigated  whether  teachers  who  scored  low  on  the 
subscales  of  an  instrument  designed  to  measure  teacher  burnout  used 
media  materials  in  their  classrooms  more  frequently  than  did  teachers 
who  had  higher  scores  on  the  subscales.    The  subscales  measured  teachers9 
perceptions  about  the  degree  of  administrative  support  received,  their 
career  satisfaction,  their  ability  to  cope  with  the  stresses  related 
to  teaching,  and  their  attitudes  towards  students        all  major  factors 
underlying  teacher  burnout  (Seidman  &  Zager,  1984). 
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Method 

Sample 

A  total  of  545  public  schoolteachers  participated  in  the  study 
in  early  April,  1984.    All  were  members  of  the  Fort  Worth  Classroom 
Teachers'  Association,  which  distributed  1490  data  packets  to  teachers 
in  all  schools  with  at  least  24  members.    The  return  rate  was  thus 
37%.     It  also  should  be  noted  that  79%  of  all  Fort  Worth  public 
schoolteachers  belong  to  this  teachers'  association.     In  the  various 
statistical  analyses,  the  number  of  valid  cases  ranged  from  470  to 
483,  due  to  the  exclusion  of  32  special  education  teachers,  and  the 
elimination  of  those  participants  who  submitted  forms  with  multiple 
responses  or  missing  data. 

These  regular  classroom  teachers  were  predominantly  female  (78.9%) 
and  married  (68.1%).    The  median  age  of  the  sample  was  42,  and  the 
rtedian  years  of  teaching  experience  was  15.    Slightly  more  than  half 
(51.2%)  of  the  teachers  indicated  that  the  bachelor's  degree  was 
the  highest  they,  held;  48. 4X  reported  that  the  master's  was  the  highest 
degree  held;  only  0.4%  had  earned  a  doctor's  degree.     Finally,  40.91 
of  the  Fort  Worth  sample  were  elementary  schoolteachers,  29.1%  taught 
in  middle  or  junior  high  schools,  and  30.1%  worked  at  the  high  school 
level.     The  characteristics  of  schoolteachers  in  this  sample  were 
similar  to  those  of  teachers  in  recent  NEA  surveys  ("Given  a  Second 
Chance/'  1983?  "NEA  Survey. n  1980|  Turner,,  1983),  except  there  was 
a  higher  proportion  of  females  in  the  present  study.    Similar  percentages 
of  both  the  Fort  Worth  sample  (73.3%)  and  those  in  the  national, 
NEA  survey  (74%)  indicated  that  they  were  relatively  satisfied  with 
their  teaching  careers  ("Given  a  Second  Chance,"  1983). 
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Instrument! 

The  Teacher  Burnout  Scale  (Zager  &  Seidman,  1983),  a  demographic 
questionnaire,  and  a  media  utilization  inventory  were  employed  In 
thia  study.    The  Teacher  Burnout  Scale  la  a  21-item,  Likert-type 
scale  with  six  response  options  ("strongly,"  "moderately,"  and  "slightly" 
a^ree  or  disagree).    It  has  four  subscalesi    (a)  perceived  administrative 
support,  (b)  career  satisfaction,  Cc)  coping  with  job-related  stress, 
and  (d)  attitudes  toward  students.    The  reliability  and  validity 
of  the  subscalea  is  high,  according  to  Seidman  and  Zager  (1984).  The 
Teacher  Burnout  Scale  (broken  down  into  subscales)  Is  presented  in 
Table  1.    The  media  utilisation  inventory  also  used  the  Likert-scale 
format  to  measure  the  frequency  that  materials  for  11  different  media 
(e.g.,  filmstrips,  motion  pictures,  and  computer  programs)  were  used 
in  one**  teaching.    Seven  response  categories  were  offered  to  participants 
"Never"  (0  points),  "A  fev  times  a  year  or  less"  (1),  "Once  a  month 
or  less"  (2),  "A  few  times  a  month"  (3),  "Once  a  week"  (4),  "A  f ew 
times  a  week"  (5),  and  "Evety  day*  (6). 
Data  Analysis 

The  scores  on  the  subscales  of  the  Teacher  Burnout  Scale  were 
summed.    Then  these  subscale  scores  were  correlated*! th  the  frequency 
of  utilization  of  materials  for  each  of  the  media  (i.e.,  Pearson 
product -moment  correlation  coefficients  were  calculated).  Additionally, 
teachers  with  low  scores  on  the  four  subscales  (I.e.,  equal  to  or 
below  an  average  of  2.0  per  item)  end.  those  with  high  scores  (i.e., 
equal  to  or  above  an  average  of  5.0  per  item)  were  placed  In  "low 
burnout"  and  "high  burnout"  groups,  respectively,  and  their  utilisation 
of  media  materials  was  compared,  using  t- tests,  on  the*  four  dimensions 
of  teacher  burnout. 

\ 
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*»  Results 

As  shown  in  Tables  2  through  5,  a  relationship  exists  between 
the  frequency  that  certain  media  materials  are  utilized  and  teachers1 
attitudes  about  their  careers  and  their  students!  as  well  as  how 
well  they  cope  with  teaching-related  stress  and  how  they  view  their 
administrators.    The  negative  Pearson  product -moment  correlation 
coefficients  indicate  that,  in  general 9  teachers  who  employed  various 
media  materials  (with  motion  pictures,  overhead  transparencies,  and 
computer  programs  being  notable  exceptions)  are  somewhat  more  satisfied 
with  their  teaching  careers,  cope  better  with  job-related  stress, 
and  have  a  more  positive  attitude  toward  students  and  administrators. 
Statistically  significant  correlation  coefficients,  for  the  total 
sample,  ranged  from  -.16  to  -.08. 

The  correlational  analysis   >?  the  combined  data  from  all  three 
types  of  school  (i.e.,  elementary,  middle/ junior  high,  and  high  school 
levels)  thus  revealed  the  existence  of  a  relationship  between  the 
utilization  of  certain  media  materials  and  the  dimensions  of  teacher 
burnout.    However,  separate  correlational  analyses  (also  reported 
in  Tables  2  through  5)  showed  that  this  relationship  was  strongest 
at  the  elementary  level- (at  which  17  of  44  Pearson  product -moment 
correlation  coefficients  were  significant  at  the  .05  level)  and  weakest 
at  the* high  school  level  (3  of  44  were  significant).  Appropriately, 
the  correlational  analysis  for  the  middle/ junior  high  school  teachers 
(10  significant  coefficients .out  of  44)  placed  them  in  between  the* 
other  two  groups.    One  should  keep  in  mind,  in  interpreting  these 
results,  that  the  elementary  group  was  larger  than  the  other  two 
groups,  thus  making  it  easier  for  the  correlation  coefficients  for 
elementary  teachers  to  attain  statistical  significance. 


In  particular,  elementary  schoolteachers  who  used  filtnstrips 
more  frequently  had  more  positive  attitudes  toward  students  (r  -  -.27), 
felt  more  satisfied  about  their  careen  (j_  -  -.18),,  coped  better 
with  job-related  stress  (r  -  -.16),  and  believed  that  they  received 
more  support  from  administrators  (_r  -  -.16).    Use  of  video  tapes, 
at  the  elementary  level,  also  was  significantly  correlated  with  these 
four  factors  of  teacher  burnout  (r  -  -.21,  -.28,  -.14,  and  -.15, 
respectively).     In  addition,  the  frequency  that  models  and  35ram  slides 
were  utilized  by  elementary  teachers  was  significantly  correlated 
to  three  of  four  burnout,  factors,  and  the  use  of  audio  tapes  £9  two 
of  the  four  dimensidns. 

At  the  middle/ junior  high  school  level,  teachers  who  employed 
games  and  simulations  felt  more- positively  about  students  (r  »  -.21) 
and  about  their  careers  (r  -  -.19)  than  did  colleagues  who  used  these 
materials  less  often..    Those  who  utilized  phonograph  records  and 
models  more  frequently  coped  better  with  teaching-related  stress 
<£  *  -.16  and  -.If,  respectively)  and  had  greater  career  satisfaction 
(r_  «  -.14  and  -.17). 

High  school  teachers  who  used  video  tapes  in  their  classrooms 
coped  better  with  on-the-job  stress  (r  ■  -.17)  and  had  a  more  positive 
attitude  toward  students  (r^  -  -.14)  than  did  teachers  who  used  video 
tapes  less  frequently.    On  the  other  hand,  there  was  a  tendency  for 
high  school  teachers  who  were  more  dissatisfied  with  their  careers 
to  utilize  computer  programs  more  often  than  did  their  more  satisfied 
colleagues  (j:  -  .14). 

t 
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finally,  means  vere  calculated  for  the  frequency  of  utilization 
of  each  of  the  11  different  media  by  "low"  and  "high  burnout"  teachers 
on  each  of  the  four  subscales  of  the  Teacher  Burnout  Scale.    As  previously 
mentioned,  only  teachers  who  (on  the  average)  were  in  strong  or  moderate 
agreement  with  "low  burnout"  items,  on  the  subscales  (after  recoding), 
were  included  in  this  analysis.    The  "low  burnout"  group  comprised 
26%  of  the  total  sample  for  Subscale  1,  27%  for  Subscale  2,  24%  for 
Subscaie  3,  and  18%  for  Subscale  4.    Teachers  who  were  in  strong 
or  moderate  disagreement  with  "high  burnout"  items  made  up  6%,  14%, 
6%,  and  7%  of  the  sample  for  Subscales  1  through  4,  respectively. 

T-tests  revealed  (as  reported  in  Tables  6  through  9)  that  14 
(of  44  possible)  pairs  of  means  were  reliably  different.    As  Table 
6  indicates,  teachers  who  believed  that  they  received  a  great  deal 
of  support  and  encouragement  from  their  administrators  used  filmstrips, 
games  and  simulations,  overhead  transparencies,  and  pictures  from 
books  and  magazines  more  frequently  than  did  teachers  who  perceived 
that  administrators  4*4 led  to  support  and  praise  their  efforts  (j>  <  .05>. 
Those  who  viewed  their  teaching  careers  positively  employed  games 
and  simulations,  video  tapes,  models  (£  <  .01),  filmstrips,  and  audio 
tapes  (£  <  .05?)  more  often  than  did  teachers  who  were  dissatisfied 
with  their  careers  (as  reported  in  Table  7).    Teachers  who  coped 
positively  with  job-related  stress  made  inore  frequent  use  of  models 

y 

(£  <  .01)  than  did  those  who  coped  negatively  (see  Table  8).  Finally, 

t 

as  Table  9  shows,  teachers  who  had  a  positive  attitude  about  students 
utilized  filmstrips  ,(j^<  .01),  games  and  simulations,  book  and  magazine 
pictures,  models,  and  video  tapes  (j>  <  .Q5)  more  frequently  than 
did  the  teachers  who  held  negative  sent^nts. 

i 


7 


10 


Discussion 

The  results  of  this  study  should  be  interpreted  with  some  caution. 
While  the  demographic  and  attitudinal  data  obtained  from  the  Fort 
Worth  sample  would  seem  to  indicate  that  it  is  fairly  representative 
of  the  public-schoolteacher  population  of  the  United  States,  all 
the  respondents  were  members  of  a  teachers'  association  and  there 
was  a  higher  proportion  of  female  teachers  than  would  be  present  ^ 
in  a  national  sample.    Furthermore,  the  37%  rate  of  return  (although 
not  atypical  for  studies  such  as  this  one)  injects  some  further  doubt 
about  the  sample.     In  addition,  the  teachers  in  the  study  were  not 
asked  about  the  availability  of  equipment  and  software,  as  well  as 
about  their  training  in  media  utilization.    Data  on  these  factors 
should  b    collected  in  future  investigations. 

Despite  the  above  reservations,  one  can  come  to  some  tentative 
conclusions.  < The  correlational  analyses  revealed  that  teachers  on 
the  lower  end  of  the  four  burnout  dimensions  tended  to  use  certain 
media  materials  more  frequently  than  did  teachers  who  were  more  burned 
out.    This  seemed  to  be  somewhat  more  the  case  for  elementary  teachers 

than  for  public  schoolteachers  at  higher  educational  levels.  While 

i 

the  relationship  between  media  utilization  and  teacher  burnout  is 

not  a  particularly  strong  one  (in  terms  of  the  magnitude  of  the  correlation 

^  coefficients)  »r  present  for  all  media  materials,  it  is  apparent 

that  the- relationship  exists.    The  lack  of  an  association  between 

teacher  burnout  and  the  utilization  of  motion  pictures,  overhead 

transparencies!  and  computer  programs,  in  general,  can  be  explained 
I  / 
by  the  probable  use  of  such  materials  by  teachers  at  all  levels  of 

career  satisfaction,  attitudes  toward  students,  coping  with  job-related 
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Klreb»,  and  perceived  administrative  support.     Films  are  often  obtained 
by  supervisors  or  interested  taaqhers  and  shown  to  raore- than- one 
class.    Overhead  transparencies  can  be  made  quickly  and  can  function 
as  software  for  "electronic  chalkboards."    Utilization  of  computer 
programs,  if  available  at  all?  is  as  likely  to  be  imposed  on  unwilling 


teachers  as  on  those  eager.  t,p  employ  this  new  technology.     In  fact, 
there  is  some  evidence  in  this  study  to  suggest  that  forcing  teachers 
to  use  computers  could  contribute  to  higher  burnout  levels  for  hi^h 


school I  instructors. 

Jjle  of  other  media  materials,  particularly  video  tapes,  filmstrips, 
35mm  slides,  and  models,  would  seem  to  demand  a  more  positive  attitude 
and  more  energy  on  the  part  of  a  teacher.    \s  Bellamy,  Whitaker, 

and  White  (1978)  wrote;     "The  majority  of  teachers  are  afraid  of  * 

/ 

media  equipment;  are  unaware  of  resources  available,  and  are  unwilling 
lo  expend  the  extra  effort  required  to  locate  media  resources,  plan 
for  the  use  of  suth  resources  in  a  presentation,  or  make  arrangements 
for  set-up  and  operation  of  necessary  equipment"  (p.  7).  Although 
factors  other  than  burnout  no  doubt  affect  media  utilization  to  some 
extent,  it  would  appear  that  teachers  who  are  victims  of  the  "burnout 
syndrome"  generally  use  media  materials  less  frequently  in  their 
classrooms. 

* 

The  analysis  of  the  media-utilization  data  of  the  "low"  and 
"high  burnout"  groups  (which  together  comprised  between  25%  to  41% 
of  the  sample)  -revealed  thst  generally  teachers  with  moderate  to 
extreme  burnout  feelings— gggtf  mcfdtJ" materials  less  than  did  those 
who  had  the  opposite  beliefs*     Almost  every  media-utilization  m an 
for  the  "low  burnout"  groups,  on  all  four  dimensions,  were  higher 
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than  were  the  means  for  the  "high  burnout"  groups,  with  differences 
for  games  and  simulations  and  for  filmstrips  statistically  significant 
on  three  of  the  four  subscales.    Pictures  from  books  and  magazines, 
as  well  as      *?ls  and  video  tapes,  also  were  more  heavily  utilized 
by  "low  burnou*"  teachers,  as  shown  by  statistically  significant 
t-test  results.     In  fact,  the  only  two  media  for  which  no  discernible 
differences  emerged  were  motion  pictures  and  computers. 

The  results  of  this  study,  although  exploratory,  indicate  that 
teachers  tend  to  use  media  materials  less  (or  not  at  all)  as  burnout 
feelings  increase.    Does  teacher  burnout  cause  victims  of  this  syndrome 
to  utilize  media  less,  or  does  the  failure  to  employ  media  enhance 
such  feelings?    We  cannot  answer  this  question,  but  it  seems  safe 
to  at  least  conjecture  that  the  unwillingness  to  use  media  is  both 
a  symptom  and  a  cause  of  burnout.     Gray  (1982)  suggested  that  the 
employment  by  teachers  of  a  variety  of  stimulating  media  programs 
and  instructional  strategies  could  help  them  "overcome  burnout  and 
face  [their]  old  jobs  with  renewed  interest"  (p.  22).    It  would  seem 
that  many  public  schoolteachers  may  become  negative  about  their  students 
and  their  careers,  and  at  some  point  "give  up."    Such  emotionally 
and  physically  drained  persons,  who  are  insensitive  to  the  needs 
of  their  students,  are  unlikely  to  use  most  media  very  often  in  their 
teaching  to  motivate  and  instruct  (if  they  ever  did). 

How  can  we  lower  burnout  levels  and  increase  the  frequency  that 
various  media  are  utilized  by  teachers?    It  is  possible  that  a  concerted 
effort  to  interest  schoolteachers  to  use  instructional  media  materials 
could  help  revitalise  those  persons  who  are  "burning  out."    If  there 
is  any  hope  of  this  strategy  succeeding,  then  it  is  necessary  that 


...  6*» 


those  concerned  with  teacher  education  and  professional  development 
provide  training  programs  and. assistance  in  media  utilization,  as 
well  as  arrange  for  workshops,  retreats,  self-support  groups,  and 
other  approaches  that  nave  proven  to  help  in  alleviating  burgout 
among  teachers. 


r 
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Table  1 

The.  Teacher  Burnout  Scale 


  %  * 

Subscale  It    Perceived  Administrative  Support  '   

*3 .    I  get  adequate  prs lac  from  my  supui vigors  for  "a  j  ob  we 1 1  done . 
~~8*~~~  I  feel  that  the  administrators  are  willing  to  help  me  with  classroom 
problems!  should  they  arise. 

11.  1  believe  that  my  efforts  in  the  classroom  are  unappreciated  by  the 
administrators. 

15.  My  supervisors  give  me  more  criticism  than  praise* 

IB.  I  feel  that  the  administrators  will  not  help  me  with  classroom 
difficulties. 

20.  The  administration  blames  me  for  classroom  problems. 

Subscale  2t    Satisfaction  with  Teaching  Career  & 

1.  I  look  forward  to  teaching  in  the  future. 

5.  I  am  glad  that  I  selected  teaching  as  a  career. 
10.  Teaching  is  more  fulfilling  than  I  had  expected. 

12.  If  I  had  it  to  do  all  over  again,  I  would  not  become  a  schoolteacher. 
19.  I  look  forward  to  each  teaching  day. 

Subscale  3s    Coping  with  Jpb-Related  Stress 

2.  I  feel  depressed  because  of  my  teaching  experiences* 
4.    The  teaching  day  seems  to  drag  on  and  on. 

7.    My  physical  illnesses  may  be  related  to  the  stress  in  this  job. 
9.     I  find  it^dlfficult  to  calm  down  after  a  day  of  teaching. 

13.  I  feel  that  I  could  do  a  much  better  job  of  teaching  if  only  the 
problems  confronting  me  were  not  so  great. 

14.  The  stresses  in  this  job  are  more  than  I  can  bear. 

Subscale  4i    Attitudes  Toward  Students 

6.  The  students  act  like  a  bunch  of  animals. 

16.  Most  of  my  students  are  decent  people. 

17.  Most  students  come  to  school  ready  to  learn. 

21.  Students  come  to  school  with  bad  attitudes. 


^Numbers  indicate  the  placement  of  the  item,  when  administered. 
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Table  2 


Pearson  Product-Moment  Correlations .Between  Use  of  Different  Media 
Materials  and  Perceived  Administrative  Support  (Subscale  1  of  Teacher 
Burnout  Scale)    _.  —   


/ 1. 

Elementary 

Middle/Junior 

ficvi  a.  lam 

School 

High  School 

High  School 

i  Total 

xeacnera 

Teachers 

-  191-192) 

(N  -  138-139) 

(N  -  139-141) 

(N  -  470-472) 

*• 

Filmstrips 

-.16* 

-.14* 

-.06 

-.10* 

35mm  Slides 

-.14* 

-.04 

-.10 

-.10* 

Pictures  from  Books 

and  Magazines 

-.08 

-.01 

.04 

-.01 

<* 

Games  and  Simulations 

-.07 

-.10 

-.11 

-.06 

Motion  Pictures 

.01 

-.07 

.13, 

.03 

Video  Tapes 

-.15* 

-    1  A* 

-  .07 

Audio  Tapes 

-.15* 

.01 

.07 

-.04 

Phonograph  Records 
> 

.00 

-.01 

.11 

.04 

Overhead  Transparencies 

-.02 

-.15* 

-.02 

-.06 

Models 

-.17** 

.03 

-.08 

-.08* 

Computer  Programs 

.02 

-.13 

-.€  ' 

-.d4 

*£  <  .05.      **£  <  .01. 
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Table  3 


Pearson  Product-Moment  Correlations  Between  Dae  of  Different  Media 

HrteriaU  and  Career  Satisfaction  (Subscale  2  of  Teacher  Burnout 
Scale) 


Med i ua 


Elementary  Middle/Junior 

School  High  School       High  School  Total 

Teachers  Teachers            Teachers  Sample 

(N  -  191-192)  (H  -  14W42)   -  (N  -  141-143)  (N  -474-476) 


• 

Films trips 

-.18** 

-.14 

.00 

•  -.13** 

35mm  Slides 

* 

-.17* 

-.03 

♦ 

-.01 

-.08*' 

Pictures  from  Books 
and  Magazines 

.02 

-.16* 

-.11 

* 

-.09* 

Gaines  and  Simulations 

-.08 

-.19* 

-.14 

-.15** 

Motion  Pictures 

-.05 

.07 

.09 

.00 

Video  Tapes  * 

-.28*** 

-.08 

-.06 

-.14** 

Audio  Tapes 

-.10 

-.13 

-.03 

: .  10* 

Phonograph  Records 

-.03 

-.18* 

.02 

-.09* 

Overhead  Transparencies 

.00 

-.10 

-.01 

-.04 

Models 

-.13* 

-.14* 

-.12 

-.14** 

Computer  Programs 

.02 

-.07 

.14* 

.03 

*P_  <  .05. 


**p  <  .01. 


***£  <  .001. 
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Table  4  * 

Pearson  Product -Moment  Correlations  Between  See  of  Different  Media  ' 
Materials  and  Coping  vith  Job-Related  Stress  (Sub scale  3  of  Teacher 
Burnout  Scale)  «. 


Medium 


Elementary  Middle/Junior 

School  '  High  School 

Teachers  Teachers 

(N  -  193-194)  (N  -  134-135) 


High  School  Total 
Teachers  Sample 
(N  -  145-147)    (N  -  474-476) 


Filmstrips  -.16* 

35mm  Slides  -.08 

Pictures  from  Books 

and  Magazines  -.06 

Games  and  Simulations  -.10 

Motion  Pictures  ■  .02 

Video  Tapes  -.14* 

Audio  Tapes  -.02 

Phonograph  Records  .01 

Overhead  Transparencies  .02 

Models  -.07 

Computer  Programs  -.04 


.12 
.12 

.02 
.09 
.02 
.00 
.02 
16* 
08 
,17* 
09 


.06 
.08 

.07 

.12 

.12 

.17* 

.06 

.09 

.04 

.01 

.04 


-.11** 
-.03 

-.05 
-.09* 

.04 
-.J  2** 
-.03 
-.01 
-.02 
-.08* 
-.05 


*£  <  .05. 


**£  <  .01. 
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Tabic  5 


Pearson  Product -Moment  Correlations  Between  Use  if  Different  Media  Materials 
and  Attitudes  Toward  Students  (Subscale  4  of  Teacher  Burnout  Scale) 


Medium 


Elementary 
School 
Teachers 
<H  -  196-197) 


Middle/ Junior 

High  School  High  School 

Teachers  Teachers 

(H  -  140-141)  (H  -  145-146) 


Total 
Sample 
(N  -  482*484) 


Filmatrips  -.27*** 

35mm  Slides  •  -.15* 

Pictures  from  Books  -.14* 
.  and  Magazines 

Games  and  Simulations  -.10 

Motion  Pictures  -.06 

Video  Tapes  -.21** 
Audio  Tapes 

Phonograph  Record a  -.04 

Overhead  Transparencies  -.01 

Models  -sl7** 

Computer  Programs  -.03  - 


-.10 

.06  * 
-.03  . 

-.21** 

.00 

-.11 

-.11 

-.13 

0 
-.02 

.02 

-.11 


.06 
.12 
.04 

.09 

.04 

.14* 

.06 

.02 

.00 

.02 

.11 


.15** 

.10* 

.10* 

.14** 
.04 

.12** 
.09*  ' 
.01 
.09* 
.00 


*p_  <  .05. 


**£  <  .01. 


***£  <  .001. 
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*  * 

Mean  Media-Utilisation  Scores  for  Negative  and  Positive  Administrative 
Support  Groups  <Subscale  1  of  Teacher  Burnout  Scale) 


Medium 

*  ■> 

Negative 
Administrative 
Support  Group 
(N  -  30) 

Positive 
Administrative 
Support  Group 
(H  -  127-129) 

"  < 

* 

t  ' 

Filmstrips 

1.33 

2.00 

2.29* 

35mm  Slides 

.50 

.71 

m 

1.34 

Pictures  from  Books 
and  Magazines 

1.93 

2.82 

2 . 26* 

Games  and  Simulations 

1.8/ 

2.81 

#    2.45*  » 

Motion  Pictures 

1.33 

1.48 

.49 

Video*  Tapes 

-  .57 

.92 

1.95 

Audio  Tapes 

1.46 

1.58 

.48 

Phonograph  Records  ' 

2.07 

2.16 

.21 

Overhead  Transparencies  *  2.40 

3.26 

2.07* 

Models 

1.50 

2.08 

1.38 

Computer  Programs 

1.03 

1.29 

.57 

* 

*  • 

*Z  <  -05. 
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•  * 

•  * 

• 

Table  7 

• 

• 

* 

« 

Mean  Media-Utilisation  Scores  for  Negative  and  Positive  Career  ~* 
Satisfaction  Group*  (Sub scale  2-  of  Teacher  Burnout  Scale) 

• 

- 

Medium 

Negative  CareeA, 
Satisfaction  Group 
(N  -  71) 

J 

Positive  Career 
Satisfaction  Group 
(M  »•  *32-134) 

_t 

Films trips 

 : — .        -  ■  

1.56 

• 

1.99 

2.14* 

35mm  Slides 

* 

« 

.54 

* 

.71 

1.26 

Pictures  from  Books 
and  Magazines 

2.83 

3.31 

1.70 

Games  and  Simulations 

2.21 

3.05 

• 

2.89** 

Motion  Pictures 

1.65 

.  1.54 

-.49 

Video  Tapes 

f 

.62 

1. 10 

3 . 16** 

Audio  Tapes  ^ 

.    %  1.17 

1.71 

2.30* 

Phonograph  Records 

2.00 

2.59 

1.83 

Overhead  Transparencies 

2.92 

,3.28 

1.19 

Models 

1.59 

2.47- 

2.74**  , 

Computer  Programs 

1.14 

*  .95 

■ 

 1  '  

-.65 

*£  <   .05.  **£  <  .01. 
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Table  8 


Mean  Media-Utilisation  Scores  for  Negative  and  Positive  Coping  with 
Job-Related  Stress  Groups  (Sub scale  3  of  Teacher  Burnout  Scale) 


t 

^Medium 

 :  it     ■           ■  — ' — 

Negative  Coping 
Group 
(N  -  30) 

Positive  Coping 
Group 
(N  -  116-118) 

s 

fiimstripa    .           '  ' 

'  1.50 

2.01 

1.76 

35mm  Slides 

.62  ' 

•87  ; 

Pictures  from' Book* 
and^ Magazines 

3.00' 

3.03 

.09 

Games  and  Simulations 

*  * 
.  2^63. 

2.91 

.65 

*» 

Motion  Pictures 

1.67 

1.38 

* 

-.88 

0 

Video  Tapes 

.60 

1.06  • 

1.90 

Audio  Tapes 

1.40 

1.54 

.39 

Phonograph  Records 

2.30 

2.35 

.10 

Overhead  Transparencies 

2.43 

3.02 

1.38 

Models 

1.20 

2.33 

• 

2.69** 

Computer ,  Programs 

i 

.  -97 

1.25- 

.63 

'Z  <  -01 
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Table  9 

Mean  Media-Utilization  Scores  for  Negative  and  Positive  Attitudes  Toward 
Student b  Groups  (Subscale  4  of  Teacher  Burnout  Scale) 


Negative  Attitudes 
Medium                            Toward  Students  Group 

(N  -  33) 

Positive  Attitudes 
Toward  Students  Group 

ar*  *.m                       af%  W         af%  4%  % 

„,(N  -  87-88) 

t_ 

Films trips 

1.36 

2\24 

3.06** 

35mm  Slides 

Pictures  from  Books 
and  Magazines 

.45 
2.48 

\ 

.76  * 

3.45  . 

1.78 
2.45* 

Games  and  Sim  '..  ions 

2.42 

3.25 

2.04* 

Motion  Pictures 

1.79 

1.66 

-.41 

Video  Tapes 

.55 

1.16 

2.58* 

Audio  Tapes 

1.09 

1.73 

1.78 

Phonograph  Records 

1.94 

2.80 

1.91 

Overhead  Transparencies 

2.94 

• 

3.43 

1.19 

Models 

1.79 

2.52 

1.72 

Computer  Programs 

1.06  * 

.95 

-.27 

*£  <   .05.     ■      **£  <  .01. 
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Examining  the  Effects  of  the  Microcomputer  on  a  Real 
World  Class:    A  Naturalistic  Study 

We  know  as  little  today  about  the  effects  of 
computers  as  we  did  about  TV's  effects  in  the 
mid-1950s.    However,  based  on  the  pace  at 
which  children  are  beginning  to  use  computers 
and  the  anecdotal  accounts  of  their  appeal  and 
educational  effects,  children's  learning  from 
microcomputers  has  become  an  important  topic 
for  research.    The  first  empirical  studies  of 
microcomputers  and  children  are  now  under  way 
at  many  universities  and  research  centers.  (Chen, 
1984,  p.  270) 

While  not  immediate \y  apparent,  Chen's  (1984)  comments  contain  a 
disturbing  fact.    In  spite  of  the  very  rapid  introduction  of  microcomputers 
into  the  nation's  classrooms  (Chen,  1984;  Kurland,  1983),  we  know  very  little 
about  the  effects  of  their  prolonged  use.    Much  early  writing  has  focused 
on  cognitive  aspects  of  using  computers,  especially  the  cognitive 
consequences  of  learning  to  program  (Papert,  1980).    But  more  recently, 
interest  in  the  social  aspects  of  using  computers  has  emerged. *  There  are 
at  least  two  reasons  why  a  consideration  of  the  social  aspects  of  this 
technology  are  pertinent.    First,  as  Chen  (1984)  notes,  few  schools  to  date 
have  been  able  to  afford  to  provide  a  computer  for  every  child.  Therefore, 
of  necessity  most  instruction  involving  the  computer  has  taken  place  with 
children  in  small  groups  or  in  pairs.    Second,  contrary  to  early  fears  that 
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children  working  at  computers  would  become  isolated  and  too  machine  oriented, 
there  has  been  some  research  indicating  that  computers  encourage  greater 
interaction  and  collaboration  among  children  than  traditional  school 
instruction  (Hawkins,  1983;  Hawkins,  Sheingold,  Gearhart,  §  Berger,  1982; 
Sheingold,  Hawkins  5  Char,  1984).    Collaborative  efforts  among  children  have  been 
lauded  in  the  literature  (Hawkins,  1983)  and  in  Vygotsky's  theories  of 
cognitive  development,  but  documentation  of  their  occurrence  with 
microcomputers  is  in  its  infancy. 

The  purpose  of  the  study  reported  here  was  to  describe  and  to  analyze 
what  happens  when  a  microcomputer  is  introduced  into  an  ongoing,  real  world 
classroom.    The  research  paradigm  assumed  was  naturalistic.    Initial  questions 
of  interest  were:    How  do  children  behave  when  confronted  wich  a  classroom 
microcomputer?    Does  the  microcomputer  encourage  children  to  interact?  What 
kinds  of  interaction  seem  to  be  precipitated  by  the  presence  of  the 
microcomputer?    How  do  children  respond  to  the  available  software?    How  does 
the  microcomputer  influence  the  role  of  the  teacher  in  the  classroom?    As  is 
typical  of  naturalistic  studies,  unanticipated  questions  of  interest  emerged 
during  the  invest igat ion . 

The  following  report  begins  with  a  brief  discussion  of  the  naturalistic 
paradigm.    Then  the  setting  in  which  the  study  took  place  is  described.  The 
following  results  section  presents  the  themes  that  emerged  during  data 
collection  and  analysis.    The  report  concludes  with  recommendations  for 
additional  research  suggested  by  this  sttfdy. 
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Methodology  v 

The  research  paradigm  assumed  for  the  study  was  naturalistic.  As 
Sheingold,  Hawkins,  and  Char  (1984)  have  noted,  the  social  life  of  the 
classroom  cannot  be  studied  via  experimentation  alone.    The  use  of 
experimental  methods  introduces  control  and  intervention  in  the  classroom 
that  renders  a  disturbed  rather  than  a  naturally  occurring  setting. 
Furthermore,  the  complex  and  fluid  nature  of  human  interaction  does  not 
lend  itself  to  control  and  quantification. 

The  rationale  for  using  naturalistic  inquiry  to  pursue  studies  such  as 
this  one  has  been  described  by  Guba  (1982),  Cuba  and  Lincoln  (1983),  Patton 
£1980),  and  others.    Basically,  the  naturalistic  paradigm  is  distinguished 
by  three  assumptions.    The  first  is  that  reality  is  holistic— all  parts 
influence  all  other  parts.    It  is  impossible  to  divide  up  reality  into 
discrete  variables  as  experimentalists  do,  holding  some  variables  constant 
while  manipulating  others,  without  destroying  the  phenomenon  under 
investigation.    The  second  assumption  is  that  the  researcher  roust  be  involved 
with  the  phenomenon  in  order  to  understand  it;  the  researcher  tends  to  become 
the  instrument  rather  than  relying  exclusively  on  tests,  questionnaires,  and 
other  so-called  objective  devices.    Third,  context  free  generalizations  or 

c 

laws  are  not  deemed  possible  by  naturalistic  inquirers.    Rather  they  seek 
thorough  description  of  phenomena  sq  that  working  hypotheses  may  be  applied 
to  other  similar  settings. 

The  study  reported  herein  sought  to  understand  what  happens  when  a 
microcomputer  is  introduced  into  an  elementary  classroom,  not  what  can  happen 
in  a  laboratory  school,  but  what  does  happen  in  a  real  class.    As  is  typical 
of  naturalistic  studies,  several  sources  of  data  were  examined.  Observers 
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were  present  in  the  class  approximately  three  hours  a  week  for  four  months. 
In  addition  to  their  field  notes  the  data  base  contains  a  fourteen  hour 
videotaped  record  of  the  children  using  the  microcomputer.    The  videotape 
was  transcribed  for  analysis.    All  of  the  •'shildren  were  asked  to  complete 
a  questionnaire  regarding  their  preferences  for\  alternative  instructional 
media,  microcomputer  software,  and  partners  when  working  on  different  kinds 
of  tasks.    The  questionnaire  was  followed  up  with  an  individual  interview 
of  each  child  seeking  clarification  of  their  responses  and  additional,  non- 
verbal information. 

The  study  was  conducted  in  a  combined  2nd  and  3rd  grade  classroom  in 
a  private  elementary  school.    The  school  is  located  in  a  small  rural  community 
in  southern  Illinois.    Twelve  students,  between  the  ages  of  seven  and  nine 
years  of  age  participated  in  the  study.    Their  teacher  was  completing  her 
first  year  of  teaching.    She,  like  the  children,  had  received  a  brief 
orientation  to  the  conjter  and  how  to  use  it.    In  addition,  an  introduction 
to  the  available  softwWe  was  included  in  this  orientatior. . 

An  informal,  relaxed  atmosphere  pervaded  the  classroom  with  children 
working  independently  and  confidently  within  it.    Learning  centers  were 
available  within  the  room,  and  children  walked  freely  from  one  to  the  other 
in  pursuance  of  their  preiss4"Tied  academic  responsibilities  for  the  day. 
The  computer  was  introduced  Into  the  classroom  as  an  additional  center. 
A  conscious  attempt  was  made  to  insure  all  children  had  an  opportunity  to 
use  the  computer,  and  specific  students  were  assigned  to  it  singly,  in  pairs, 
or  in  small  groups.    When  computer  usage  had  not  been  specifically  scheduled, 
optional  access  was  available. 

During  a  two  week  period  prior  to  the  initiation  of  the  study,  the  two 
observers,  the  video  operator,  and  tjie  video  equipment  were  introduced  into 
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the  classroom.    The  researchers  became  accepted  as  part  of  the  class,  while 
the  children  were  allowed  to  become  familiar  with  the  camera  and  how  it 
--worked.    Actual  taping  began  the  week  immediately  following  this  orientation 
and  ^he^introductory  orientation  to  the  computer.    The  camera  was  placed  in 
a  spot  convenient  to  the  computer.    Since  the  study  focused  upon  the  computer 
and  the  children's  interactions  with  and  around  it,  it  soon  became  apparent 
that  the  camera  could  be  set  and  left  virtually  unattended  during  the  course 
of  each  session.    Thus,  the  unobtrusiveness  of  the  equipment  and  operator 
was  enhanced. 

Data  analysis  followed  a  typical  qualitative  approach.    The  data  were 
reviewed  and  tentatively  coded.    A  content  analysis  was  conducted,  and 
themes  in  the  data  identified.    At  this  writing  the  data  analysis  is  far 
from  exhausted.    The  results  presented  here  are  preliminary  and  further 

data  analysis  using  alternative  strategies  progresses. 

f 

Results 

f 

The  results  of  the  study  are  described  below  as  themes  that  emerged 
during  data  collection  and  analysis.    The  following  results  should  be 
viewed  as  tentative.    Their  validity  is  threatened  because,  while  the 
children  were  observed  for  a  longer  period  of  time  than  that  frequently 
allowed  in  experimental  studies,  a  much  longer  period  would  be  required 
before  confidence  could  be  placed  in  the  results.    In  spite  of  their  limitations, 
the  results  provide  a  good  starting  point  for  forming  hypotheses  to  be  pursued 
in  future  research. 
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Differences  in  Response  , 

Not  surprisingly  there  appeared  to  be  differences  in  the  ways 
individual  children  responded  to  the  microcomputer.  Some  of  these 
differences  are  described  below. 

Differences  in  enthusiasm.    Clearly  not  all  the  children  responded  to 
the  microcomputer  with  the  same  level  of  interest.    Such  differences  are  not 
discussed  in  most  of  what  is  written  about  microcomputers;  merely  reading 
the  microcomputer  literature  can  leave  one  with  the  impression  that  all 
children  are  naturally  drawn  enthusiastically  to  this  technology.    Such  a 
notion  appears  to  be  a  myth.    Detecting  differences  in  interest  level  appears 
to  require  observation  of  'children'  with  computers.    When  children  were  asked 
during  their  interviews  whether  or  not  they  liked  the  school's  microcomputer, 
they  all  answered  that  they  did.    When  asked  on  a  questionnaire  to  choose 
among  worksheets,  television  programs,  and  the  microcomputer  for  work  in  math 
and  in  language,  the  computer  was  generally  selected  as  the  preferred  medium, 
and  was  never  the  least  preferred.    However,  when  observing  children  at  the 
microcomputer  and  during  those  periods  of  optional  access,  it  was  apparent 
that  some  had  an  avid  interest  in  the  machine,  while  others  gave  it  only 
superficial  and  fleeting  attention. 

Sex  differences.    The  results  of  this  study  lend  some  support  to  the 
sex  difference  in  response  to  computers  already  suggested  elsewhere  in 
preliminary  research  (Becker,  1982;  Hawkins,  1984).    As  noted  above,  observing 
children  working  with  computer!  is  essential  for  exploring  these  differences; 
when  interviewed  or  asked  on  the  questionnaire,  girls  and  boys  alike  expressed 
favorable  attitudes  toward  the  microcomputer.    However,  the  observation  data 
seem  to  indicate  a  difference  between  the  girls'  and  the  boys'  behavior  at  the 
machine.    The  boys  seemed  more  interested  in  getting  the  machine  to  perform 
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different  functions.    Hawkins  (1984)  stated  the  phenomenon  well,  "Boys 
wanted  to  control  it"  (p.  12).    The  girls  seemed  store  likely  to  use  the  drill 
and  practice  programs- -to  stay  within  the  dictates!  of  the  established  program  * 
rather  than  to  explore  the  machine's  capabilities.  \  Hawkins  (1984)  has 
speculated  that  the  sex  difference  may  be  due  in  large  part  to  the  curricular 
pairing  of  computers  with  math  and  science  sub jects,\  thus  invoking  the 
societal  sanction  against  female  involvement.    However,  during  observations 
of  the  classroom  viewed  for  this  study,  the  microcomputer  was  never  designated 
*  as  a  subject  allied  with  either  math  or  science.    The  Available  software 
involved  language  and  music  as  well  as  math.    These  tentative  outcomes  do  not 

appear  to  support  Hawkins'  hypothesis.  J 

j)  * 

Age  differences.  Among  older  children,  it,  appeared  that  the  frequency  of 
interaction  surrounding  the  computer  tended  to  decrease  during  the  four  months 
that  the  class  was  observed.    A  similar  decxe^eJb.Jhi^xex^W«OOt  seem  to 

occur  among  the  younger  children.    This  finding  may  be  partially  explained  by 

•i 

the  younger  children's  continuing  nfeed  for  assistance  in  simply  operating  the 
computer-- loading  the  software  and  setting  software  parameters. 

Class  Management 

Some  of  the  study's  results  seem  to  have  implications  for  class 
management . 

Computer  mechanics.    An  analysis  of  children's  behavior  and  interaction 
when^using  the  microcomputer  revealed  that  a  substantial  portion  of  their 
'computeivtime'  was  spent  in  simply  trying  to  get  the  computer  to  run  the 
chosen  softwar^.    Technical  and  logistical  problems  were  frequent.  The 
teacher  or  the  chb.<  'expert'  was  called  repeatedly  to  correct  these  problems. 

X 

It  was  not  uncommon  forX^he  teacher  to  call  in  the  child  'expert'  when *the . 
problem  was  one  she  could  not^handle.    Children  were  observed  waiting  and 
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waiting  and  waiting  for  such  assistance  before  they  could  progress  through  a 
program.    Needless  to  say,  such  episodes  seemed  to  generate  frustration  for 
the  teacher  as  well  as  the  children.    Much  of  the  time  that  the  children 
spent  at  the  computer  was  unproductive. 

Computer  rights.    Also  revealed  by  the  analysis  of  children's 
interaction  when  using  the  computer  was  the  surprising  frequency  with  which  i 
the  children  had  to  assert  verbally  or  nonverbally  their  right  to  control 
the  computer  keyboard.    While  the  total  amount  of  time  taken  by  these 
squabbles  was  not  great,  their  effect  was  to  interrupt  task  oriented  behavior. 
When  more  than  two  children  were  present  at  the  computer,  this  behavior 
became  even  more  pronounced.    Hoarding  of  the  keyboard,  pushing  away  hands, 
and  verbal  reprimands  were  common  in  such  situations;    The  child  seated  at 
the  computer  was  frequently  beseiged  with  'advisers1  usually  offering 
conflicting  advice.    This  situation  may  have  been  aggravated  by  a  characteristic 
of  microcomputers  in  schools  noted -by  Sheingold,  Hawkins  and  Char  (1984)  and  ' 
by  Hawkins  (1983);  microcomputers  have  not  yet  become  an  established  part  of 
the  curriculum.    Their  legitimacy  in  the  eyes  of  teachers  and  therefore  also  * 
of  students  has  not  been  confirmed.    Consequently,  children  are  more  likely  to 
interact  freely  where  computer  tasks  are  concerned;  the  taboos  surrounding  not 
doing  one's  own  work  seem  not  to  have  taken  hold  of  computer  tasks  yet. 

Role  of  the 'child  expert*.    The  impact  of  microcomputers  on  formal 
educational  settings  is  only  now  beginning  to  be  studied,  while  the  impact  of 
personal  computers  on  the  home  setting  is  yet  to  be  explored.    The  accessibility 
of  personal  computers  in  the  home  has  created  the  unique  phenomenon  of  the 
child  'expert* .  *  -  . 

The  child  'expert'  in  the  current  study  was  called  upon  by  peers  and 
teacher  alike  for  technical  and  logistical  assistance.    Many  children  appealed 
to  him  for  approval  of  their  creative  endeavors.    But,  noticeably  absent  from 
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an^" of  the  resultant  interchanges  were  the  mature  interactive  behaviors  one 
would  expect  from  an  adult  teacher  expert.    Hyman  (1974)  states  clearly 
there  is  an  interpersonal  aspect  of  teaching,  in  which  the  teacher 
roust  encourage  learning  and  must  himself  respect  'intellectual  integrity 
and  capacity  for  independent  judgement ,M  (p.  25).    It  would  appear  unlikely 

c 

that  many  child  experts  would  be  capable  of  developing  such  a  relationship 
with  their  peers.  Thus,  the  role  of  the  child  'expert'  should  be  explored 
systematically. 

Role  of  the  teacher.    This  study  seemed  to  indicate  that  the  introduction 
of  the  microcomputer  into  the  classroom  placed  many  additional  demands  on  the 
teacher.    In  addition  to  the  more  obvious  demand  that  the  teacher  master  the 
technology  were  the  increased  classroom  management  tasks.    As  no.ted  above, 
the  teacher  was  very  frequently  interrupted  when  working  with  other  children 

t 

to  come  to  the  aid  of  the  child  using  the  computer.    The  teacher's  monitoring 
of  the  children's  access  to  the  machine  also  drew  her  frequent  attention;  she 
repeatedly  had  to  instruct  children  to  leave  the  computer  area.  Finally, 
choosing  appropriate  software  for  classroom  use  is  an  additional  responsibility 
the  teacher  must  assume. 

« 

Software  evaluation.    Char  (1983)  suggests  three  major  criteria  which 

\ 

should  be  used  in  determining  '-he  appropriateness  of  software  for  classroom 
use:  'coraprehensibility,  appeal,  and  usability..   Observations  of  children's 
reactions  to  the  available  software  in  this  study  were  analyzed  in  relationship 
to  these  factors. 

Some  chpjJren  in  the  study  frequently  appeared  confused  not  only  by  the 

»• 

general  objectives  of  some  of  the  software  assigned  them,  but  also  by  the 

*  •  « 

mechanical  processes  involved  in  'making  the  program  run' .    Others  were 

clearly  unchallenged  by  the  same  software,  while  a  few  children  were  interested, 
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challenged  and  obviously  happy  with  the  tasks  presented  them.  These 
observations  support  Char's  findings  (1983)  in  suggesting  the  use  of 
comprehensibility  as  an  evaluative  criterion  in  choosing  software,  and 
support  the  demand  for  a  wide  variety  of  software  designed  for  various* 
skill  and  conceptual  levels. 

As  mentioned  earlier,  different  software  appealed  to  different*  children. 
While  girls  seemed  to  prefer  drvli  and  practice,  boys  appeared  to  prefer 
software  which  allowed  for  creative  control  of  the  computer.    Responses  of 
all  children  using  drill  and  practice  programs  highlighted  some  unique 
problems  for  program  designers.    It  was  apparent  that  the  program's  'positive' 
rewards  tor  correct  responses  to  the  provided  stimuli  were  not  always 
appropriate  for  the  individual  user.    Some  children  engaged  in  silliness  as 
they  made  faces  at  the  computer  and  mimicked  the  sounds  it  maae  in  recognizing 
their  success;  some  expressed  disgust  at  the  repetitiveness  of  the  reward  and 
actually  lost  si^ht  of  the  drill  and  practice  goals,  intentionally  making 
errors  in  Order  to  change  the  computer's  response;  others  expressed  their 
boredom  as  they  waited  impatiently  for  the  completion  of  the  reward  in  order 
to  get  on  with  the  reslTof  the  program.    Many  available  programs  have  overcome 
the  difficulties  associated  with  timing  responses  to  meet  individual 
performance  needs,  but  more  research  is  needed  to  discern  appropriate  and 
varied  'rewards'  for  successful  task  completion.    It  appears  incorrect  to 
assume  that  all  children  are  highly  motivated  by  the  same  rewards. 

An  earlier  reference  to  the  boys  wanting  to  control  the  computer  keyboard 
focuses  on  the  third  criterion,  that  of  usage.    The  behaviors  observed  in  this 
study  support  the  need  for  the  creation  of  more  software  which  can  be  used 
effectively  by  more  than  one  child  at  a  time. 

The  naturalist  research  paradigm  employed  in  this  study  allowed 
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observations  of  the  interactions  of  children  around  a  computer  In  a  real 
classroom.    Analysis  of  those  observations  suggests  the  need  for  further 
rejoarch  into  problem  areas  affected  by  the  computer's  presence  in  the 
classroom.    Areas  suggested  for  further  study  include:    the  relationship 
of  differences  in  sex,  age,  and  cognitive  stxie  to  computer  usage;  the 
identification  of  additional  demands  upon  the  teacher  for  technical  knowledge 
and  skill  in  evaluating  software  effectively;  the  identification  of  the  4 
effects  on  a  child  of  assignment  to  the  role  of  class  'expert';  and,  the 
design  of  more  and  varied  software  which  meets  the  criteria  for  successful 
usage . 

It  was  obvious  throughout  the  study  that  the  presence  of  a  computer 
in  the  classroom  is  far  from  enough  to  assure  advances  in  learning.  The 
computer  is  merely  another  teaching  tool  whose  success  is  dependent  upon 
the  way  in  which  a  well-prepared  teacher  can  accommodate  th't  additional 
knowledge,  classroom  management  techniques,  and  software  design  awareness 
that  s/he  will  need  to  use  the  .computer  effectively. 
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BACKGROUND  TO  THE  PROBLEM 
Examination  of  lift  in  tht  classroom  ctnttrt  around  myriad 

r 

atptctt  that  turf act  in  tht  educational  tnvironmtnt.   Host  often 
education*!  rtsttrch  focuaes  upon  strategies  and  stimuli  dtsigntd  to 
product  a  particular  typt  of  ptrformanct  outcomt.    Rt starch 
inttrumtnts  art  usually  dtsigntd  in  behavioral  form  and  inttrprtttd 
through  quantifiable  and  mtasurablt  objective*.    Tht  picture  is 
usually  compltttd  through  tht  ust  of  various  psychological  aptitude 

t  *  « 

and  achUvement  ttsts  that*  illustrate  tht  tf ftctivtntss  o*  the 
particular  strattgy  or  stimulus. 

While  certain  aspects  of  the  classroom  may  be  captured  by  this 
psychological  model,  othtrs  are  not.    Research  of  this  Kind  looks  at 
educrfon  in  a  vacuum,  and  concentrates  on  the  individual  and 
individual  behaviors.    Occassional ly  there  is  an  exploration  of  mtntal 
processing,  ajj»n  cognitive  psychology.  Relationships  art  rtductd  to  a 
stt  of  stimuli  and  rtsponsts,  or  hypothtses  and  feedback.  Social 
inttraction  analysis,  insttad  of  limiting  its  invtstigation  to 
interpretation  of  tht  results  from  somt  prtdtttrmintd  suptr impostd 
structurt,  attempts  to  invtstigatt  tht  meaningful  patterns  and  rults 
of  usagt  in  social  bthavior  by  txamining  it  in  its  situational 
context. 

Tht  emergtnct  of  new  ttchnologits  in  tht  classroom  sttting  is 
nearix  always  mat  with  tht  former  model  of  rtsttrch.   Various  media, 
whether  print,  photography,  film,  television,  audio,  svfdto,  or 
computer  are  investigated  to  determine  their  psychological  impact. 
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Sometimes  tht  particular  attribute*  of  a  medium  art  aasessed  to 
identify  which  ones  night  bttt  deliver  car tain  kinds  of  mees,ages  to 
cartain  kind*  of  laarnara  doing  cartain  kind*  of  taaks  (Salomon, 1979). 
Again,  this  ia  an  application  of  a  particular  atructurt,  soma  medium 
or  medium  attribute,  used  aa  a  stimulus,  to  provoke  some  form  of 

* 

response.    Result*  from  thia  kind  of  experimentation  yield 
quantitative  conclusions  that  can  be  used  to  predict  similar  outcomes 
in  simitar  situations.    However,  such  situations  rarely  exiat.  In 
this  model  tha  setting  ia  controlled}  the  individual  (subject)  being 
examined  is  considered  neutral  and  without  intentions,  and  the 
relationship  among  existing  variables,  the  social  interaction,  is 
ignored. 

Few  children  come  to  thes  classroom  today  without  some  form  of 
social  relationship  with  the  media.  Educators  need  only  listen  to  the 
conversations  among  students  on  the  playground,  in  the  halls,  or  at 
lunch,  to  recognize  tht  such  a  relationship  exists.    Research  that 
ignores  the  intentions  of  such  individuals  when  they  interact  with 
media  in  an  educational  setting  presents  a  subtle  form  of  distortion. 
Research  that  allows  the  individual  (participant)  the  opportunity  to 
give  an  account  of  her/his  rtlationahip,  and  describes  tha  setting  in 
which  the  interaction  takea  place,  attempts  to  eliminate  this  form  oi 
distortion. 

Media,  and  their  accompanying  technologies,  have  evolved  from  ink 
on  paper  to  light  upon  a  chemical  emulsion  to  electronic  signals  upon 
a  screen.    The  last,  electronic  technology,  has  allowed  the  combining 
of  a  visual  medium,  video,  with  a  computational  medium,  comptlte>,  to 
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form  •  hybrid  known  as  "interactive  video."    In  order  to  further 
accomodate  this  new  medium  certain  technological  development*  have  and 
continue  to  occur.    One  development' of  interest  to  researchers  in 
educational  technology  is  the  videodisc.    This  soft wart  and 
accompanying  devices  used  in  its  operation  are  considered  to  have  a 
dynamic  quality  that  does  not  exist  with  video  tape.    From  a  simple 
physical  examination  this  would  seem  apparent.    Tape  is  linear,  and  to 
get  from  one  point  in  its  presentation  to  another  all  the  tape  in 
between  must  pass  by  the  electromagnetic  head  which  then  reads  the 
information  desired.    For  this  reason,  most  material  produced  for 
videotape  is  sequential  or  linear  iir  form.     On  the  other  hand,  a 
videodisc  is  made  up  of  concentric  circles,  and  to  get  from  one  point 
in  its  presentation  to  another  a  laser  beam  moves  angularly  across  one 
of  the  radii  of  the  disc.    This  provides  the  opportunity  to  produce 
material!  that  is  not  sequential  or  linear,  but  randomly  accessible  and 
dynamic    in  form.  (Bennion  and  Schneider,  1975§  Love,  \979\  Kemph, 
1981f  Onosko,  1982). 

Instructional  media  research  has  focused  on  the  application  of 
this  medium  in  the  role  of  individualized  instruction.    Bunder son 
(1979-1980)  acknowledges  that  videodisc  technology  combines  two 
traditions!  the  artistic  tradition  of  motion  pictures  and  video,  and 
the  analytic  and  empirical  tradition  of  programmed  and  self -paced  . 
instruction.    Representative  of  the  predominate  view,  Bunder son 
assigns  strong  motivational  features  to  the  former,  and  instructional 
facilities  to  the  la*ter.    The  use  of  behavioral  analysis,  which 
breaks  the  program  into  stimulus-response  steps  for  the  learner  to 
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follow  it  considered  to  product  "nor*  relevant  L&haviors."    Tht  use  of 
critical  analysis,  coming  from  tht  artistic  tradition,  or  critical 
vitwing  skills  uatd  to  inttrprtt  information  prtstnttd,  it  not  tvtn 
contidtrtd  in  this  discussion  of  instructional  methodology. 

Elsewhere,  Bundtrson  (1981)  states  tht  nttd  to  mtrgt  tht  thrtt 
traditions  to  achieve  tht  most  effective  ISO  (Instructional  Systems 
Development)  modtl.  Again,  tht  artistic  tradition,  taemplified  by 
notion  picturt  sequences," is  sttn  as  bting  "limited  in  tht  cognitive 
instructional  content"  arta.    Bundtrson  argues  that  thtst  sequences 
rtqui rt  most  of  tht  information  bt  carritd  in  tht  audiotrack,  si  net 
visual  prtstntations  require  "slowpaclng'  to  bt  tfftctivt.  In 
contrast,  Arnheim  (1969)  views  all  thinking  as  a  product  of  ptrctption 
and  visual  imagery.    In  this  argument,  mental  images,  which  includt 
picturts,  symbols,  and  signs,  art  sttn  as  a  precursor  to  thov*tt. 

In  their  discussion  of  systems  tmploying  vidtodisc  ttchnology,  4. 
Allen  and  Allen  (1983)  stated  that  successful  users  expand  traditional 
bthaviorist  and  cr i ttr ion-rtftrtneed  modtl s  to  includt  focustd 
discovtry,  cognitive  and  afftctivt  domains,  and  Social  Learning  Thtory 
with  its  awartntss  of  inttractions  among  behavior,  cognition  and 
tnvironmtnt.    This  stattmtnt  coincides  with  Molnar's  (1979-1980) 
obstrvation  that  currtnt  instructional  paradigms  art  inadequate  for 
new  technology  and  Innovation. 

In  discussing  an  "interactive*  medium,  it  is  important  to  rtalizt 
that  inttractions  art  not  always  txplaintd  by  an  8-11  or.cognitivt 
modtl.  Prtssing  buttons  in  rtsponst  to  visual  stimuli  docftot 
constitutt  tht  tntirt  stt  of  inttractions  between  a  studtnt  and  a 
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vidtodisc  system  in  an  educational  totting.  Many  interact  ions  resul t 
Iron  the  cultural  context  of  tbt  classroom.  Meaningful  patterns  of 
social  behavior,  and  the  rules  of  usage  governing  relationships,  and 
infractions  emerge  Iron  the  situational  context. 

While  behaviorist,  cognitive  and  other  psychological  paradigms 
nay  permit  the  formation  of  models  in  which  students  rtspond  w 
procest  certain  stimuli,  they  are  unable  to  explain  tht  dynamics^ of 


social  interaction.   This  limitation  of  these  paradigms  makes  it 
difficult,  if  not  impossible,  to  adequately  research  " interact ivt 
video."     Therefore,  in  order  to  properly  conduct  this  study  of 
interactivity,  it  is  necessary  to  reach  beyond  the  parameters  of 
current  educational  research  paradigms.    This  study  utilizes  the 


social  interaction  analysis  paradigm  to  discover  the  relationship 
between  elementary  school  students  and  a  videodisc  system  in  an 
educational  environment. 

STATEMENT  OF  THE  PROBLEM 

Tht  purpose  of  this  study  is  to  observe  the  relationship  betwetn 
elementary  school  students  and  a  videodisc  system. in  an  educational 
tnvironment.    Rather  than  examining  the  developmental  effectiveness 
this  "interactive*  medium  has  upon  students,  the' study  explores  the 
larger  question  of  what  kinds  of  interactions  are  exhibited  when 
studtntt  and  videodisc  technology  are  brought  together  in  an 
educational  setting.    This  investigation  is  aimed  at  disclosing 
meaningful  patterns  < Blur ton  Jones  and  Woodson,  1979)  of  social 
behavior  that  develop  through  tht  observable  features  of  the 
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prtctdmg,  contemporary  and  tubstqutnt  behaviors*  of  students  and  the 
fit  dim*  in  such  a  tatting.    Through  comprehens  ivt  analysis  of  thtst 
patttrnt  this  study  provides  information  that  will  permit  tht 
effective  imp lamentation  of  curricula  that  bring  togtthtr  t 1 tat ntary 
school  studtntt  and  videodisc  ttchnology  in  an  educational 
tnvironntnt. 

In  order  to  fx  taint  tht  full  range  of  phtnomtna  that  dtvtlop  whtnc. 

n 

a  vidtodisc  system  and  elemtntary  studtnts  coexist  in  an  t  ducat  tonal 
sttting,  a  social  inttraction  thtorttical  framework  is  ustd  to  dirtct 
this  rtstarch.    This  paradigm  ptrmits  tht  observer  to  examine  tht 
inttntions  of  tht  studtnts,  tht  impact  of  tht  tnvironntnt,  and  othtr 
non-quant  if iablt  information  that  may  bt  ptrtintnt  to  tht  Hevelopment 
of  a  comprthtnt ivt  inalysis. 
STUDY  GOALS  AND  OBJECTIVES 

1)  What  kindV  oTlwanTngfllT Trattfrns  tmtrgt  through  tht  obstrvation  of 
social  bthaviors  that  occur  bttwten  an  tltmtntary  school  student 
and  a  vidtodisc  system  in  an  tducational  environment? 

2)  During  tht  courst  of  the  interaction  between  the  elementary  school 
student  and  the  videodisc  art  these  meaningful  patterns  more  often 
examples  of  acceptance  or  resistance? 

3)  During  tht  course  of  the  inttraction  do  elementary  school  students 
exhibit  more  active  or  passive  behavior  when  interacting  with  a 
yideodise  system  in  an  educational  environment? 

V)  Do  elementary  school  ttudents  that  havt  interacted  with  a  videodisc 
lystem  in  an  educational  environment  perceive  the  system  to.be 
■friendly,"  "intelligent,"  or  able  to  carry  on  a  "conversation"  or 
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-dialog?" 

9)  Art  any  meaningful  pattern*  of  social  interaction  between 

elementary  tchool  students  and  a  vidtodiac  system  in  an  educational 

environment  Qender  specific? 
a)  What  impli cat  ions  Mould  these  meaningful  patterns  have  for 

curriculum  development  which  includes  the  utilization  of  videodisc 

technology? 

7)  What  implications  for  further  research  may  be  derived  from  this 
sfrdy? 

ASSUMPTIONS 

Educational  environments  provide  an  arena  for  both  the  cognitive 
development  and  social  interaction  of  their  inhabitants.   While  the 

a 

relationship 'between  instructional  events  and  the  students'  cognitive 

i 

ability  mediate  what  is  learned,  there  is  a  tendency  on  the  part  of 
educational  research  to  focus  on  mental  events.    Elementary  school 
classrooms  and  media  centers  are  communal  settings  in  which  students 
evolve  from  a  collection  of  individuals  into     "working  social  groups" 
(Amarel,  1983).   The  social  interaction  of  students  with  each  other 
and  with  the  environment  is  a  determinant  of  educational  productivity. 

Survival  requires  that  in  a  social  context  individuals  be  able  to 
behave  both  cooperatively  and  competitively.    Evidence  of  both 
cooperative   and  competitive  context  have   been   found   in  research  of 
educational  environments  (Slavin,  1983s   Johnson  and  Johnson,  1975| 
Vereen,  1983) .    In  most  educational  situations  the  cooperative  context 
or  behavior  exhibiting  acceptance  is  more  desirable  and  conclusive  to 
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learning. 

Children  have  experiences  that  It  id  to  tht  formulation  of 
concepts,  attitude*,  and  opinions  long  before  their  first  school 
experience.   Manx  of  these  early  experiences,  along  with  many  others 
outside  of  school,  influence  the  perceptions  and  expectations  of  a 
child.    Soae  of  these  undoubtedly  influence  their  behavior  in  school. 
Experiences  outside  of  school  influence  students'  intentions  toward, 
as  well  as  their  expectations  and  perceptions  of,  the  educational 
environment. 

DEFINITIONS  of  KEY  TERMS  and  SYMBOLS 

Videodisc  era terns  A  system  of  a  videodisc  player,  color  monitor,  and  a 
videodisc.    In  some  instances,  a  microcomputer,  interface  device, 
computer  software,  and  additional  monitors  are  included.    In  this 
study,  a  level  one  < Kemph ,    1981 j  Onosfco,  1982)  or  manual  < Bunder son, 
1979-1980)     videodisc  player,  a  videodisc  with  a  program  specifically 
designed  for  this  medium,  and  a  color  monitor  are  used. 

* 

"Interactive   video* i   An   electronic  medium   that    incorporates  still  , 
motion,  and   text  in  the  visual  track,  and  syr.chron i ted  and 
non-synchronized   sound  on  two  separate  audio  tracks.    User  choice  is 
inherent  in  the  medium  and  is  administered   through  control  over  the 
pace  and  sequence   ©*"  the  presentation     (Bunder son,     Hoe kerns,  Hon, 
Wilson,  Worcester,    and  Woodward,    1983).     Features  that  facilitate 
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this    behavior    include  fast  random    access,    freeze    franc,  forward 
and  reverse,    slow,    fast,    step,    and  "rtal    time*  got  ion,  and  mono 
or  dual  audio  selection. 
Levels   of    interaction!    Capabilities  of  videodisc  systems    art  refered  to 
at  Itvtlt  of  Interaction  (Bunder ton,  1979-80 i  Kemph,  1961 |  Qnosko, 
1982). 

Level  One  refert  to  a  "manual"  commercial  optical    videodisc  player 
capable  of  a  mixture  of  still  and  motion  sequences,  and  which  permits 
the  user  to  select  portions  and  control  the  pace  of  the  presentation. 
Level  Two  refers  to  an  educational/ industrial  optical  videodisc  player 
capable  of  automatically  branching  users  to  parts  of  the  presentation 
for  review,  reinforcement,  etc.    Some  simple  forms  of  sCorekeeping  are 
also  possible  by  programming  the  player's  microprocessor. 
Level  Three  refers  to  an  educational/industrial  optical  videodisc 
player  Interfaced  with  a  microcomputer  capable  of  generating  graphics 
and  text,  editing  questions,  and  keeping  detailed   records.  The 
microcomputer  program  can  guide  the  entire  presentation  and  evaluate 
a12  responses. 

Social  interactioni  The  interrelationship  of  a  set  of  overt  behaviors, 
verbal  and  non-verbal,  of  an  individual <s)  In  a  social  environment. 

Educational  environments  The  total  set  of  circumstances  surrounding  an 
Instructional  event.    In  this  study,  the  total  set  of  circumstances 
includes  the  physical  and  social  dimensions  wherein  an  instructional 
event  occurs.   The  physical  dimension  is  referred  to  as  the  videodisc 
system  and  the  classroom,  instructional  media 'center,  or  laboratory 
settino.   The  social  dimension  is  referred  to  as  and  inclusive  of  all 
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events  in  the  instructions)  context  (adapted  from  Vereen,  1983). 
8SR  (Senders,  Signal t,  and  Receivers)  Systems  An  ttfpirically  derived 
method  for  cattrgor ical ly  recording  observations  of  complex. social 
»  interactions.    The  method  include!  keyboard  entry  and  computer 

tranter ipt ion  of  grammatically  structured  strings  of  characters  that 
are  used  as  codes  to  describe  the  observations.    The  defining 
properties  of  the  codes  reduce  redundancy  in  the  entries  and  direct 
the  flow  of  Program  PLEXYN  (Stephenson,  Smith,  and  Roberts,  l?75j 

o 

Stephenson,  1979). 

PLEXYN i  A  computer-compatible  grammar  processing  program  that  verifies,' 
completes  and  reformats  SSR  system  code  into  a  record  for  subsequent 
data  analysis. 

DELIMITATIONS  of  the  STUDY 

This  study  is  limited  to  upper  elementary  school  students.  The 
sample  is  drawn  from  a  middle  sized  urban  community  in  the  Midwest. 
The  socioeconomic  status  and  ethnic  background  of  the  sample  it 
„    diverse,  but  consists  primarily  of  white  middle  class  students.  No 
attempt  has  been  made  to  randomize  the  sample,  therefore,  the  results 
of  ths  study  are  not  general  liable  beyond  this  or  similarity 
constituted  populations. 

Analysis  of  sor.ial  behavior  is  limited  to  an  educational 
environment,  and  does  not  attempt  to  answer  questions  regarding 
videodisc  systems  in  training  or  entertainment.   Any  implications  that 
may  be  found  in  this  study  as  regard  these  areas  would  require  further 

research . 
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THE  REVIEW  OF  RELATED  LITERATURE 
Tht  rtvitw  of  littraturt  In  thit  chapttr  is  comprittd  of  both 
thtorttical  and  tmpirical  rtatarch  ralattd  to  thit  atudy.   Tht  rtvitw 
contiatt  of  littraturt  from  vidtodiac  rtatarch  and  a  chroniclt  o.f  .tht 
historical- dtvtloptttnta  loading  to  ita  uat  in  tducationj  tducational 
ptradioma  surrtntly  uatd  in  tht  rtatarch  of  vidtodiac  and  othtr 
innovativt  ttchnologitai  thtorttical  and  mtthodolegical  iatuta  in  ^ 
tocial  inttraction  analyaiat  and,  rtatarch  on  tht  obatrvatlon  of 
childrtn. 


VIDEODISC  SYSTEMS I  HYPE  or  HOPE? 

f 

Tht  prom i at a  of  vidto  disc  hark  back  to  thoat  days  in 
tht  latt  19th  ctntury  whtn  Man  firat  ptrftcttd  a  rtliablt 
rat  in §  of  mtchanically  rt producing  sound.  Tht  Amtricana 
Altxandtr  Graham  8t11  and  Thomas  Edison,  tht  Frtnchman 
Charlta  Cloa,  tht  Italian  Ouglitlmo  Marconi  and  tht  Dant, 
Valdtmar  Poulaon  with  thtir  invtntions  of  tht  taltphont! 
phonograph,  radio  and  mtchanical  rtcording  dtvict, 
discovtrtd  how  to  convtrt  sound  into  tltctrlcal  impulats  and 
thtn  back  into  sound  (SIgtl,  1980). 


Thtst  samt  principlts  wtrt  applitd  in  1927  whtn  John  Legit  Baird 
dtvtloptd  "Phonovision",  tht  first,  howtvtr  crodt,  vtrsion  of  a 
vidtodiac  systtm  (Schubin,  1988).    Tht  ntxt  major  dtvtlopmtnta  in 
vidto  occurrtd  afttr  World  War  II  with  tht  introduction  of  tht  vidto 
tapt  rtcordtr.   Vidto  rtturntd  to  a  diac   format  in  19*3  whtn  Magna tic 
Vidto  Rtcording  providtd  COS  ttltvision  with  a  ^agnatic  diac  for 
producing  stop  action  and  inatant  rtplay.   This  vidtodiac  systtm 
continutt  to  bt  th»  'buKkon.  of  tport*  covtr.8.'  <Schubin,  >M0). 

Two  typ.f  of  vidtoditc  ty.ttni  h.vt  b».n  dov.lop.d  during  tht 
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1970s  and  first  part  of  tht  1980s.    The  first,  or  contact  systems, 
developed  by  TelDec  (Telefunken  of  Germany  and  Dtcca  of  Britain),  JVC, 
and  RCA,  uat  styluses  that  make  contact  with  tht  turf act  of  tht  disc, 
and  resemble  phonograph  technology  as  it  apptars  during  this  tint 
'period.    Tht  second,  or  optical  systems,  dtvtloptd  by  Philips,  MCA, 
Thomson-CSF,  and  Sony,  us*  lastr  styluses  ttiat  ntvtr  touch  tht  surf act 
of  tht  disc,  but  stnd  a  been  of  'light  that  is  tither  transmitted' 
through  or  reflected  off  the  disc  to  a  decoding  device  that  reads  the 
electronic  signal  (Schubin,  1980).    Characteristics  unique  to  tht 
optical  vidtodisc  system  make  it  the  only  practical  model  to  be  used 
for  educational  purposes,  hence  any  further  rtftrtnet  in  this  study  to 
videodiscs,  vidtodisc  systems  or  videodisc  technology   should  be 
regarded  as  referring  to  this  type  of  format. 

Bennion  and  Schneider  <I973)  were  among  the  first  to  move  from 
mainframe  directed  video/slide  presentation  for  individualised  v 
instruction  to  the  world  of  video  contained  in  a  single, videodisc 
system.    Comparisons  were  immediately  made  between  potential 
applications  of  videodisc  systems  and  the  Time-shared  Interactive 
Computer  Controlled  Instructional  Television  (T-ICCIT)  project  of 
programmed  instruction  that  they  were  involved  with  at  that  time.' 
Advantage*  of  tht  vidtodisc  system  over  tht  TltCIT  projtct  according 
to  these  researchers  was  its  greater  audio  capabilities,  motion 

K  -  m 

control,  and  lack  of  rtlianct  on  an  txttrnal  computer. 

*  * 

.  Schnei der  (1975)  attemoted  to  make  a  case  for  the  cost  tff ieiencv 

-•*•«■   > 

of  vidtodisc  ovtr  othtr  media  by  doing  a  par  unit  comparison.  Whilt 
mass  production  of  tht  disc  may  bt  low  in  this  comparison,  costs  for 
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commercial  production  of  content  for  this  medium  havt  bttn  estimated, 
elsewhere,  at  between  ont  and  thrtt  thousand  dollars  ptr  minute 
(Kehrberg  and .Pollack,  1982)  Hiscox,  1982}  Eastwood,  1978-197?)  Paris, 
1981),  and  necessarily  drives  tht  ptr  unit  coat  up.  For  industrial 
training  investments  of  this  type  may  not  be  a  deterrent  in  tht 
development  of  tht "videodisc,  however,  in  educition  expenditures  of 
this  siie  are  a  cause  for  concern. 

Other  researchers  involved  with  the  development  of  programed 
individualized  instruction  started  to  advocate  tht  implementation  of 
videodisc  systems  <8ork,    1 978-79 |  Bunder ton,  1979-1980)  Molnar, 
1979-1980).   Host  of  the  research  focused  on  the  potential  for  "full 

♦ 

multimedia  "  (Bork,  1978-79)  instructional  program*  on  stand-alone 
systems,  or* a  "dry  laboratory")  where  students  can  work,  or 
"intelligent  electronic  books"  (Molnar,  1979-1980)  for  student!  to 
query.    The  failure  to  modestly  appraise  the  potential  of  this 
technology  in  favor  of  lauding  the  way  it  so  neatly  fits  into  the 
programmed  instruction  model  is  evident  in  Bunder son's  (1982) 
acknowledgment  that  researchers  at  the  Uaterford  School,  a  prototype 

e> 

for  this  method  of  instruction,  anticipated  learner  productivity  to 
improve  ten  to  a  hundred  fold, after  the  implementation  of  this 

technology.  '    m    \  *j  ' 

Paris  (1981)  argues  that  the  miny  "myths"  surrounding  research  of 
videodisc  technology  could  create  false  expectations  and  actually 

inadvertently  hurt  itt   development.   Rather  than  Imagine  "future" 
possibi  1  Hies,  research  should  focus  on  what  the  technology  "can  do 
^oday."   Among  the  misconceptions,  proliferated  at  the  time  of  Paris' 
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writing,  were  tht  following  on ft  which  she  attempted  to  debunkj 
"videodisc,  will  replace  tht  book)  typewritten  of f ice. mater  1*1  is 
compatible  with  videodisc  technology  (Tht  aspect  ratio  of  typing  paper 
end  television  screens  ere  not  compatible.) |  the  Encyclopedia  is 
readable  when  stored  on  a  single  videodisc)  and,  information  can  be 
cheaply  stored  on  videodisc,  » 

Hfscox  (S982),  also,  cautioned  against  overstating  the 
significance  of  videodiscs  in  education.   Attempting  to  find  a 
suitable  method  for  curriculum  development  in  the  remote  areas  of 
Alaska,  he  considers  videodiscs  to  have  only  a  limited  role  in 
instructional  situations.    Rel iabi 1 ity  of  equipment  (hardware), 
complexity  of  the  instructional  program,  difficulties  in  evaluating 
and  revising  disc-based  programs,  and  costs  of  "interactive"  videodisc 
systems   Mere  sited  as  deterrents.    Implementation  of  videodiscs, 
according  to  Hiscox,  "... suffers  from  severe  practical  limitations  and 
is  not  likely  to  have  a  substantial  impact  on  teaching  methods  in  the 
next  decade.* 

1  Eastwood  < i 973-1979)  presented  numerous  deterrents  to  educational 
use  of  "intelligent  videodisc"  systems.   Among  thesa  wtrt  tht  lack  of 
faculty  inctntivts  to  adapt  this  new  technology/  a  lack  of  skilled 

personnel  and  appropriate  facilities  for  videqcfiscs,  a  rtsistanct  to 

e 

change  in  education,  and  the  maintenance  of  Jht  traditional  role  of 

adoption  of  innovation  and  technology  into  the  curriculum  depends  "on 
such  factors  as  the  teachers'  assessment  ,of  tht  quality  and  value  of 
the  lessons  relative  to  their  own  instruction,  on  the  amount  of 
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disruption  thty  wtre  willing  to  tolerate,  and  on  tht  firmness  with 
which  thty  htld  to  their  customary  teaching  practices." 

Another  problem  Eastwood  (1978-1979)  points  out  is  tht  lack  of 
valid  tducational  rt starch  about  videodisc  technology-  Whl1tf 
proccf  mat  ions  about  potential  nay  stir  interest,  the  critical  nature 
of  education  requires  research  to  substantiate  claims  made  concerning 
pedagogical  effectiveness.  Unfortunately,  dtspitt  rapid  growth  in 
training  applications,  videodiscs  have  received  only  minimal 
utilization  in  education.        a  result,  what  follows  is  a  nearly 
exhaustive  summary  of  research  completed  at  this  time. 

Tht  most  sophisticattd  videodisc  technology  wa*  developed  by  the 
MIT  Arch i tec turt  Machint  ©roup  (Backer,  1982).    The  program  is 
designed  to" teach  the  fundamtntals  of  bicycle  maintenance  and  repair. 
Tht  dtsign  incorporatts  diagrams,  txplodtd  vitws,  and  continuous 
sound. 

At  tht  othtr  tnd  of  tht  sptctrum  is  a  program  ttaching  tconomics 
*    to  high  school  studtnts  in  sparst  artas  of  Minnesota.    This  program 
was  dtsigntd  on  a  shot string  budgtt  by  Kehrberg  and  Pollack  (1982). 

An  area  that  is  growing  in  the  utilization  of  videodisc 
technology  is  special  education  <Thorkildsen  and  Allard,  19B2|  LaSow, 
1979-198*).    Reading  programs  for  the  hearing  impaired  and  the 
mentally  handicapped  were  the  subjects  of  these  videodisc  projects. 

Making  use  of  old  film  footage  to  teach  a  lesson  In  physics 
limited  tht  cost  exptnditur.  of  producing  the  Tacoma  Narrows  Bridge 
Collapst  <2ollman  and  Fuller,  1982). 

Bundtrton  (1979-1980)  dtsigntd  a  biology. program  for  a  manual 
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videodisc  player,  such  as  the  out  used  in  this  study/  Tht  program 
rtquiret  students  to  use  study  skill  analagous  to  thost  ustd  to  find 
information  in  a  ttxtbooic. 

Ptrhaps  tht  most  ambitious  rtstarch  and  development  Mas  tht 
effort  of  Kirchntr  (1982,1983),  Mho  both  productd  and  fitld  ttsttd  an 
elementary  health  program  about  tht  htart  and  circulatory  sv«tM» 


METHODOLOGY 

Tht  purpost  of  this  study  is  to  analyze  tht  social  inttraction 
between  elementary  school  students  and  videodisc  systems  in  an 
educational  environment.  A  triangulated  design  utilizing  empirical, 
analytical,  and  critical  models  of  data  colltction  directs  this  study. 
Tht  first  part  of  tht  design  is  tht  observation.   An  inttrvieM  Mith  \ 
each  of.  the  participants  follOMS  tht  conclusion  of  tht  observations. 
Tht  third  part  of  tht  investigation  is  a  survey  of  tht  partnts  and 
teachers  of  the  students.  .Each  part  of  tht  design  Mill  bt  trtsttd 
stparattly  in  stctions  of  this  chapter. 

SAMPLE  POPULATION 

Tht  eamp It  population  for  this  study  Mas  drawn  from  a  small 
mid*etttrn  urban  environment  of  approximately  175,000  inhabitants. 
Host  of  this  community  consists  of  governmental  MorKtrs  that  strvict 
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the  univertity  or  ttate  egenciee  that  art  ctnttred  in  this  city. 
There  it  imt  light  Induttry,  at  well  at  tout  conmrcial  tnttrprittt 
in  tht  ctntral  city  and  artat  around  tht  periphery  of  tht  city. 
School  enrollment  decline  hat  tapered  off,  and  there  it  ditcuttion 
about  rtopening  tone  tchoolt  that  wtrt  doted  during  the  decline. 
Prttently,  the  tchoo!  dittrict  it  undergoing  tchool  "pairing"  at  part 
of  a  detegregation  program  that  Mat  initiated  during  the  current 
tchool  year.    Both  tchoolt,  tht  one  that  terved  at  the  tite  of  the 
pilot  ttudy,  and  tht  one  that  ttrvtd  at  tht  trte  of  the  final  ttudy, 
Mere  cited  by  the  dittrict't  human  relatione  director  at  having  a 
diverte  population. 

The  intact  groupt  that  comprittd  the  pilot  ttudy  and  final  ttudy 
Mere  one  third  and  tMO  fourth  grade  clattet,  rttptcti vely.    The  pilot 
ttudy  Mill  be  ditcutted  in  more  depth  later  in  thit  chapter.  There 
were  nine  girlt  and  ttn  boyt  in  one  fourth  grade  clatt,  and  tight 
girlt  and  twtlve  boyt  in  the  other  fourth  grade  clatt.   Thrte  black 
and  tixtten  Mhite  children   made  up  the  ninttttn  mtmbtrt  of  tht  firtt 
clatt,  and  two  black  and  eighteen  Mhite  children  made  up  the  tMenty 
membert  of  tht  tecond  clatt.   mil  clattet  Mere  hettrogentoualy 
grouped,  and  reformed  to  conttitutt  homogeneout  group ingt  during  math 
and  rtading  lettont.    Studentt  participated  in  the  obterved 
interaction  Mith  the  vidtoditc  tyttem  only  in  their  "hcmtroom." 

Achievement  tcoret  Mere  not  available,  but  reading  groupt  ranged 
from  nearly  a  year  behind  in  the  batal  teriet  to  a  year  ahead.    In  one 
math  clatt  the  investigator  Mat  prttent  when  the  teacher  thowed  a  film 
reviewing  batic  multiplication  and  divition  facta,  which  mott  of  the 
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clttf  seemed  proficient  it  answering,  at  observed'  by  their  responses 
to  problems  posed  in  the  film  and  Mall  charts  indicating  their  scores 
on  speed  drills. 

While  a  videodisc  player  and  accompanying  software  have  been 
available  in  the  school  district  for  the  past  three  school  years,  the 
implementation  of  this  technology  has  been  nearly  non-existent  in  the 
curriculum.    According  to  the  school  district  media  director,  and  from 
other  inquiries  made  by  the  investigator,  the  best  assessment  is  that  " 
videodisc  systems  have  encountered  limited  utilization  at  the 
secondary  level  and  almost  no  utilization  at  the  elementary  level. 
Several  reasons  for  this  failure  were  given  by  one  of  the  fourth  grade 
teachers  involved  in  the  study  in  an'informal  interview.  First, 
unlike  movie  and  slide  projectors,  which  are  present  each  school ,  a 
videodisc  player  must  be  retrieved  from  the  central  administration 
building.    Second,  according  to  this  teacher,  "...you  practically  have 
to  sign  your  life  away,"  in  order  to  acquire  this  equipment.  The 
lack  of  quality  software  was  given  as  the  final  deterrent. 

PILOT  STUDY 

The  third  grade  class  involved  in  the  pilot  study  was  in  a 
neighboring  school  to  the  school  which  housed  the  fourth  grade  classes 
involved  in  the  final  study.    Eleven  girls  and  eight  boys  made  up  the 
constituency  of  this  class.  Two  black,  two  native  American,  one 
Hispanic,  one  Vietnamese,  and  thirteen  white  children  made  up  the 
nineteen  members  of  this  class. 

All  the  instrumentation  and  procedures  for  the  observation, 
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interview,  end  survey  Mere  tht  same  at  those  ustd  in  the  final  study. 
The  only  differenct  it  that  the  raw  data  recorded  by  the  SSR  keyboard 
was  not  transcribed  by  Program  PLEXYN  for  further  analysis.  The 
purpose  of  the  pilot  study  Mas  to  develop  proficiency  in  the  use  of 
the  instrumentsf  and  to  help  refine  the  behavior  categories.  More 
information  about  behavior  categories  follows  in  the  next  section  on 
instrumentation. 
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INSTRUMENTATION 

Tht  instrument  for  the  observation  was  the  SSR  (Stndtrt ,  Signals, 
and  Receivers  in  Stephenson  and  Roberta,  1977)  system  Keyboard  for 
recording  communication  event*,  along  with  Program  PLEXYN  (Stephenson, 
1979),  a  compu ter-compet  i bl e  grammar  that  tranacribet  character 
strings  typed  in  by  an  observer,  and  which  permits  the  rapid  coding  of 
complex  social  interactions  without  the  observer  having  to  look  away 
from  the  events  being  recorded.   A  program  was  written  that  allowed 
the  investigator's  Apple  ilc  to  simuUte  the  SSR  Keyboard.  Each 
student  record  was  stored  as  a  separate  file  on  a  floppy  disc.  Files 
were  later  transferred  to  an  IBM-DOS  floppy  disc  for  reformatting  and 
transcription  by  Program  PLEXYN. 

The  following  model  was  devised  by  the  researcher  to  enable  a 
theoretical  perspective  for  analyzing  the  complex  social  interactions 
exhibited  when  elementary  school  students  interact  with  videodisc 
systems  in  an  educational  environment.    First,  student  social 
interaction  can  be  characterized  as  belonging  in  one  of  two  large 
domains.    Either  the  student  accepts  the  educational  experience,  or 
s/he  resists  the  educational  experience.    This  can  be  further  divided 
into  four  distinct  states  of  the  social  system  active  acceptance, 
passive  acceptance,  passive  resistance,  and  active  resistance.  Each  of 
these  manifests  itself  through  various  pat  teas  of  behavior  that  can 
be  distinguished  from  each  other  by  their  level  of  intensity.  The 
following  table  <see  Table  1)  illustrates  these  manifestations. 
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TABLE  1 

MANIFESTATIONS  of  the  SOCIAL  INTERACTION  SYSTEM 
in  ELEMENTARY  SCHOOLS 


ACTIVE  ACCEPTANCE 
PASSIVE  ACCEPTANCE 

PASSIVE  RESISTANCE 
ACTIVE  RESISTANCE 


"LIMITED 

Enthusiastic 

Docile 

Indifferent 
Flippant 


MODERATE 
Energetic 
Caipl iant 

Nonchalant 
Disobedient 


EXTREME 

Exuberant 

Obedient 

Obstinate 
Hostile 


All  of  tht  obstrvable  behaviors  fit  into  thttt  twelve  categories. 

Many  of  tht  initial 

behaviors  in  tht  fint  bthavior  catalogue  were  derived  from  othtr 
observational  studies,  and  tht  researcher's  own  experience  at  a 
teacher  in  an  elementary  school  claatrooa.    For  tht  pilot  study  a  list 
of  ovtr  one  hundred  bthaviors  wtrt  defined  and  put  in  tht  catalogue. 
After  tht  pilot  study  sort  than  one  third  of  tht  original  bthavior 
categories  wtrt  removed  btcautt  they  failed  to  appear  tvtn  once,  and 
were  assessed  upon  reflection  as  being  highly  unlikely  to  occur.  An 
additional  fiftttn  new  categories  emerged  during  the  pilot*    In  all, 
seventy-four  bthaviors  wtrt  defined  and  used  in  tht  final  study 
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Analysis  of  thtst  bthaviors,  and  placement  in  tht  corrtct 
claisif i cat  ion  in  tht  social  inttraction  system  it  dtptndtnt  on  not 
only  tht  incidence  of  tht  bthavior,  but  its  duration,  repetition,  and 
sequence  of  occurence.    Program  PLEXYN  through  its  fourteen  defining. 
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categories  searches  for  errors  in  recording,  removes  redundancy  in  the 
rtcord,  turns  off  categories  through  mutual  exclusion  <i.tf  a  studtnt 
cannot  cut  and  fold  paptr  at  tht  taut  tint),  and  ptrmitt  tht  insertion 
of  subjects  and  objects  by  dt fault  <i.t.f  alow  notion  hat  tht 
videodisc  system  for  ita  subject,  while  rtada  acrtan  hat  tht  atudtnt 
for  ita  subject  and  tht  vidtodiac  system  for  ita  object).  Through 
cartful  investigation  of  tht  data  meaningful  patttrnt  emerge 

Tht  instrumentation  for  tht  Interviews  and  survey  will  be 
txplaintd  in  tht  following  tactions. 

INTERVIEWS 

Inttrviews  wtrt  conducttd  with  stvtntttn  of  tht  ninttttn  students 
in  tht  pilot,  and  thirty-tight  of  tht  thirty-nint  students  in  tht 
final  study.    Tht  rtaaon  for  tht  exclusions  in  all  three  instances  was 
dut  to  student  abatnet.   The  original  intention  of  tht  rtatarchtr  was 
to  conduct  interviews  following  the  observations  to  tnablt  tht  lint  of. 
inquiry  to  ptrtain  to  tht  particular  behaviors  observed. 
Unfortunately,  in  securing  permission  to  conduct  this  study  it  was 
necessary  to  prepare  any  questions  to  be  used  beforehand  for  approval 
by  the  external  rt&tarth  committee  of  the  school  district.  Tht 
following  questions  (*t<*  Tablt  2>  wtrt  asked  of  tht  students  afttr 
completion  of  the  observations. 
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TABLE  2 I  STUDENT  INTERVIEW 
(Interviews  with  students  ware  tape  recorded.) 

1.  What  is  your  nana?  (This  was  done  to  gain  rapport.  Anonymity  was 

assured.) 

2.  Briefly,  atatt  what  you  learned  from  working  with  tht  videoditc 
ay at em. 

3.  What  did  you  lika  about  this  mat  hod  of  Warning? 

4.  What  didn't  you  lika  about  this  itathod  o*  Warning? 

5.  What  othar  things  do  you  think  could  ba  learned  using  a  videodisc 
systan?  Siva  soma  examples. 

6.  Did  you  feel  comfortable  using  tha  videodisc  systan?   Why  (or,  why 
not)? 

7.  Did  you  think  tha  vidaodisc  systan  was  "friendly?"   Why  (or,  why  not)? 

8.  Did  you  avar  think  you  could  "talk  to"  or  carry  on  a  "convarsat ion"  or 
■dialogue"  with  tht  vidao  progran?  <H  so,  tall  why  you  thought  this, 
and  it  thara  wara  any  particular  tinas  whan  you  thought  this 

« 

"convarsat ion*  occurrad.) 

9.  Did  tha  vidaodisc  systan  saan  "snart"  or  " intall ir-nt?"  Why  (or,  why 
not/? 

10.  Did  you  feel  lika  you  wara  in  control  of  tha  lasaon,  or  did  tha  lasaon 
seeaito  control  you? 

11.  Did  you  avar  feel  narvous?  Why? 

12.  How  much  computar  experience  hava  you  had  at  school?  bona?  alsawhara? 

13.  How  much  vidao  experience  hava  you  had  at  school?  noma?  alsawhara? 
Did  any  of  this  includa  tha  usa  of  a  vidaodisc  systan? 

14.  How  often  do  you  watch  talavision  at  school?  noma?  alsawhara? 

15.  Do  you  avar  play  arcada  garnet?  Where?  How  often? 
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SURVEYS  \ 

Tht  final  ptrt  of  the  investigation  mm  *  survey  of  the  parents, 
teachers,  and  aominittrator  of  tht  studtntt  involvtd  in  tht 
observations  and  interview*.  Again,  tht  intention  watttierive 
statements  from  tht  obatrvatfon  and  student  answers  to  questions, 
however,  prior  approval  Mat  necessary  to  ttcurt  ptmitaion  to  conduct 
tht  survey.   Tht  following  table  <3)  providta  tht  statements  to  which 
partntt,  ttachtrt,  and  administrator  were  asked  to  rttpond.  A  lint 
with  a  continuum  from  strongly  agree  to  strongly  ditagrtt  with 
unctrtain  in  tht  middle  was  provfdtd  on  tht  distributed  turvtyt. 

TABLE  3 i  PARENT  and  EDUCATOR  SURVEY 

1.  Students  need  Itarning  experiences  utilizing  videodisc  systems. 

2.  Studtntt  art  Itat  apprehentive  than  ttachtrt  about  advancing 
technology. 

3.  Studtntt  nttd  to  Itarn  about  vidtoditc  systems  and  computer  technology 
at  school , 

4.  School  curriculum  it  too  overloaded  already  to  add  videodisc  and 
computer  studies. 

5.  Software  selection  is  as  Important  as  textbook  selection. 

6.  Videodisc  systems  and  computer  ttchnol  ogy  dehumanize  schools  and 
classrooms. 

7.  Students  work  better  with  machines,  such  at  vidtoditc  and  computer 
systems,  than  thty  do  with  tach  othtr. 

8.  Inttrptrtonal  skills  development  decreases  among  studtntt  utilizing 
vidtoditc  systems  and  computer  technology. 

9.  Conversation  or  ■dialogue*  with  -artificial  intelligence'  it  pott i bit. 
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PROCEDURES 

Etch  class  participating  in  the  study  took  a  week  to  complete  the 
observational  portion  of  tht  investigation.   At  the  start  of  tacit  of 
thttt  weekt  tht  clttt  undtr  investigation  wat  given  t  prfttntttion 
explaining  what  a  videodisc  systeo  it,  and  how  it  workt.  .  Explanations 
art  give*  an*  o  demonstration  of  how  to  uee  the  renote  control  device 
to  obttin  *rett  tint,"  alow  notion,  fast  notion,  ttill  front,  tttp 
front,  and  rtvtrtt  is  illustrated.   Tht  stops  for  finding  a  ntw 

4 

chapter  on  tht  First  National  Kidisc  wtrt  outlintd,  and  sont  of  tht 
chapttrs  wtrt  prtvitwtd.   This  softwart  was  stltcttd  btcaust  of  tht 
difftrtnt  type*  of  activitits  and  various  interests  it  provides  for, 
as  wall  as  tht  opportunity  to  give  tht  student  control  ovtr  tht  widttt 
post i bit  choice  of  tht  kind  of  interaction  dtsirtd,  whilt  at  tht  sant 
tint  providing  an  instructional  task  to  be  ptrfomed.   Tht  First 
National  Kidisc  was  not  specifically  designed  for  use  in  education, 
but  an  educational  consultant  was  part  of  tht  production  staff 
(Bliiek,  1982). 

ft  schedule  was  drawn  up  by  tht  teacher  and  researcher  assigning 

t 

thirty  ninute  periods  for  each  child  to  work  with  the  videodisc  • 
system.    Periods  when  students  were  working  with  specialists,  such  as 
tht  art,  nusic  or  physical  education  ttachtr,  wtrt  avoided. 

i 

The  videodisc  system  was  set  up  at  tht  far  and  of  each  room  in 
learning  center  fashion.   The  learning  center  consisted  of  a  desk  with 
supplies  stored  inside  for  paper  folding,  knot  tying,  secret  code 

t 

chart  construction,  and  flip  books  (simple  animation) .   The  19*  Zenith 
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color  ttltvition  that  strvtd  at  tht  monitor  woo  plactd  ot  tyt  Itvtl  in 

I 

front  o*  tht  dttk.   This  Mat  a  major  improvement  ovtr  tht  pilot  study 
which  had  a  cart  that  forced  tht  otudtntt  to  look  up  at  tht  monitor. 
In  both  classrooms  in  tht  final  study  tht  Pioneer  VP- J 000  Videodisc 
player  with  tht  First  National  Kidiec  aWtady  inaide  waa  plactd  to  tht 
atudtnta'  right-hand  aid*.    In  tht  first  classroom  sinct  tht  desk  was 
so  large  tht  playtr  was  stt  right  on  tht  deck.    In  tht  othtr  classroom 
it  was  plactd  on  a  car^  tht  samt  htight  as  tht  Oak. 

Two  charts,  ont  with  instructions  reviewing  tht  ittms  given  in 
tht  class  prtstntation  and  another  with  tht  various  chapters  for 
stltction  from  tht  softwart  wtrt  at  tht  station  so  tht  studtnt  may 
work  independently.   Tht  at  wtrt 

plactd  flat  on  tht  largt  dtsk  in  tht  first  classroom,  and  weQ 
htld  up  by  chart  stands  about  tht  nonitor  and  vidtodisc  player  in  tht 

% 

•  *  '  % 

othtr  room.    Tht  rtmott  control  dtvict  waa  stt  on  tht  dtsk  in  tach 
classroom.  * 

Tht  f irat  f ivt  minutts  of  tach  ptriod  wtrt  sptnt  reviewing 
proctdurts  prtatnttd  in  tht  original  claaa  orientation.    Students  wtrt 
given  a  chanct  to  attempt  a  chapttr  search,  and  to  ask  any  qutstiona 
about  tht  proctdurta  they  might  have  btfort  btginning  tht  lstson. 
Once  tht  studtnt  waa  ready,  tht  vidto  c antra  that  was  at  a  right  anglt 
to  tht  studtnt 's  right  sidt  was  activattd.  Tht  computer  program  waa 
booted  and  tht  observer, who  because  of 'limited  space  had  to  sit' on 
the  same  aide  of  the  student  aa  the  vidto  carter*,  began  to  record  tht 
social  inttraction  between  the  atudent  and  tht  vidtodisc  system  in  the 
tnvtronmtnt  htrtin  dttcribtd* 
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T8  and  CONCLUSIONS 

81 net  this  It  a  rtport  on  rtstarch  in  progress,  at  tht  tint  of 


this  conftrtnet  vary  1 ittlt  it  known  about  tht  obstruction.  Tht 


obttrvation  that  can  bt  nadt  ft  that  tht  "novtlty  tfftct"  it  tvidtnt 
in  that  Jt  product*  txcittmtnt  in  mm  ovtr  tht  possibility  of 
something  difftrtnt  to  do,  and  crtattd  anxitty  in  othtrt  btcauta  of 
tht  ftar  of  tht  unfamiliar.   Thit  dm  not  apptar  to  tay  too  such,  but 
it  mutt  -bt  rtaliitd  that  vidtoditc  tysttmt  art  a  ntw  technology,  and  » 
ntarly  tvtrywhtrt  in  tducation,  and  particularly  at  tht  tltmtntary  . 
Itvtl  thit  tfftct  it  going  to  bt  tncounttrtd  for  tent  tint. 

Tht  minimal  rttultt  currtntly  avai labia  from  a  curtory 
txam'i nation  and  tabulation  of  rttponttt  to  tht  interviews  with 
ttudtnta  rtvtalt  no  appartnt  differences  bttMttn  gtndtr  regarding 
attitudes  and  ptrctptiont  of  vidtoditc  tytttmt.   Kost  of  tht  students, 
thirty-six  of  thirty-hint,  or  nintty-two  ptrctnt  claiiatd  to  bt 
condor tab It  working  with  tht  vidtoditc  system.   An  even  hightr 
ptrctntagt,  thirty-tight  of  thirty-hint,  or  nintty-ttutn  ptrctnt  found 
tht  system  -friendly.-   Thirty-two  ttudtntt,  or  eighty- two  ptretntf 
thought  tht  vidtoditc  tysttm  wat  "smart'  or  Bintt11 igtnt, ■  whilt  two 
thought  otherwise,  and  four  ttudtntt  wtrt  unctrtain.    Possibly  tht 
most  dividtd  rttpontt  cone trntd  who tht r  or  not  a  "conversation*  or 
"dialogue"  could  bt  held  with  a  vidtoditc  tytttft.    Sixtttn,  or 
forty-two  ptrctnt,  thought  thit  wat  a  pottibility,  whilt  tightttn,  or 

u 


obttrvation  filtt  havt  not  gont  through  tht  transcription  proctts  of 
Program  PLEXYN  at  thit  timt.  Tht  only  pott i bit  rtmarKt  rtgarding  tht 
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forty-seven  percent,  did  not  think  this  was  possible,  thrtt,  or  tight 
percent,  put  forth  i  tentative  maybe,  and  one,  or  thret  ptrctnt,  did 
not  know. 

Biographical  information  gaintd  through  these  interviews 
indicattd  a  high  incidtnct  of  television  viewing  ranging  on  tht 
average  about  two  hours  an  evening,  and  slightly  higher  viewing  timet 
on  the  weekend,  by  the  students'  own  estimates.    Ten  student*,  or 
twenty-six  percent  had  personal  computers  at  home,  and  an  equal  number 
f ««ned  video  tape  recorders. 

Finally*,  while  the  results  are  not  complete,  the  evidence  is 
clear,  at  least  to  this  researcher  that  in  studying  student 
interaction  it  is  necessary  to  expand  current  educational  research 
paradigms  to  include  social  interaction  analysis. 
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FtkSUAiiUU:  FIVt  MuOltS  UtAtlfcb  Ml tH  fMt  KtLAl  iUhihlFi  btlwttfc  MtUlA,  \ 
AllllUUtb  AND  LtAKNlNb  HVU 

Attitudes  are  predispositons  to  respond  Uimbaroo  and  tobesen  i.y/u).  in 
otner  woros,  attitude  helps  shape  suosequent  behavior.  5ince  attitudes 
are  relatively  stable  and  enduring,  but  still  subject  to  persuasion, 
tney  are  important  to  educators  because  many  oelieve  that  they  have 
some  impact  on  learning. 

Fleming  and  Levi e  UWo)  make  a  convincing  argument  tor  why  educators 
should  oe  concerned  with  attitudes  and  their  modification.  First,  it  is 
apparent  that  eoucators  00  attempt  to  convince  others  of  the  importance 
of  certain  ideas,  such  as  attitudes  related  to  social  issues  like  the 
treatment  of  minority  groups.  Attitudes  also  affect  tne  way  people 
attend  to  ideas  anu  events.  People  pay  attention  to  what' they  enjoy, 
and  tend  to  ignore  or  misinterpret  what  tney  dislike.  It  1$  also  likely 
that  information  is  retained  more  easily  when  it  is  consistent  with 
attitude  positions,  and  is  more  difficult  to  remember  when  it  is 
counter  attitudinal.    m  final  reason  attitudes  and  their  formation  are 
important  to  educators  is  so  that  biasing  messages  can  be  identified 
and  modified  either  during  the  design  process  or  during  instruction 
i Fleming  and  Levie,  ly/b). 

ms  early  as  Thurstone  was  aole  to  demonstrate  the  impact  of  a 

single  filmed  message  on  the  attitudes  of  children,   using  a  pretest, 
posttest  design,  Ihurstone  found  that  cniloren's  attitudes  toward  china 
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and  Chinese  culture  could  oe  modified  either  positively  or  iegatively, 
depending  on  the  intent  of  a  motion  picture  they  watcned.  other 
researchers  have  found  generally  similar  results,  Kor  example,  tevonian 
W^o.*)  used  an  audience  assessment  to  tailor  the  content  ot  a  film 
aoout  India.   nttituoes  ot  viewer*  &t  tne  motion  picture  were  change© 
significantly. 

«<* 

simonson  119/*?  j  swnftari zed  the  results  of  over  two  hundred  research 
studies  that  investigated  attitude  change  and  found  the  literature 
see«.ed  to  indicate  that  persuasive  messages  were  often  successful  when 
instructional  media  such  as  films,  videotapes,  slides  and  tilmstrips 
were  used  to  deliver  them.  However,  it  was  also  reported  oy  Simonson 
that  nedia/Mttitude  research  was  somewhat  suspect. 

Several  reasons  were  given  for  questioning  the  results  of  research  on 
media  and  attitudes.  Kirst,  tne  attitude  construct  investigate  in  many 
of  the  studies  Mmonson  reviewed  was  often  not  clearly  defined,  as  a 
dependent  van  aole  used  to  test  hypotheses,  the  attitude  topic  was 
rarely  explained  as  fully  as  were  achievement  variaoles.  A  second 
concern  was  the  inadequacy  of  tests  used  to  measure  attitudinal 
outcomes,  over  fifty  percent  of  the  time,  Simonson  found  that  tnere  was 
no  uescriptive  information  reported  aoout  the  measure  of  the  attitude 
dependent  variable,  finally,  many  of  the  studies  used  poor  experimental 
designs,   uften,  attitude  measurement  did  not  seem  to  oe  the  primary 
concern  of  the  researcner.  Kather,  attitude  testing  was  often  a 
post- hoc  analysis  of  peripheral  importance  to  the  main  purposes  and 
design  of  the  study. 
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in  spue  of  these  problems,  there  seemed  to  he  sotoe  coon  on 
characteristics  of  successful  persuasive  instructional  messages  tnat  if 
included  in  their  planning,  production,  or  utilization  would  contribute 
to  dttituoe  cnange.  as  a  result  of  tms  review,  Mmonson  ilbiv*) 
proposed  six  guidelines  for  using  instructional  media  to  change 
attitudes. 

Recently,  however,  a  number  of  questions  concerning  the  impact  of 
instructional  media  have  been  made,   une  of  the  most  interesting 
summaries  of  instructional  media  research  was  presented  by  Clark 
U*jj).  ms  a  basic  theme  for  this  review,  dark  stated  "The  best 
current  evidence  is  that  media  are  mere  vehicles  that  deliver 
instruction  but  do  not  influence  student  achievement  arty  more  tnat  the 
truck  that  delivers  our  groceries  causes  changes  in  nutrition."  iciarn, 

44t>)  clam  also  stated  that  the  results  of  reviews  of  media 
research  published  in  vtie  last  several  years  seem  to  be  unambiguous  and 
unanimous  in  finding  that  any  research  results  that  reported  a 
relationship  between  media  and  achievement  were  pro© ably  confounded, 
invs  confounding  was  usually  caused  by  either  instructional  metnod  or 
content  differences  between  treatments,  or  a  novelty  effect  for  the 
newer  media. 

It  is  important  to  note  that  Clark  reported  on  research  summaries  with 
achievement  as  the  dependent  variable,    in  other  words,  it  &m$  to  be 
Clark's  opinion,  baseu  on  literature  reviews,  that  media  do  not 
influence  achievement,  and  that  one  medium  is  not  superior  to  another 
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in  producing  wore  positive  learning  outcomes.  However,  Uam  dia  not 
uiscuss  attitudes.    Ine  results  ot  media  researcn  stunaanzed  by  Dark 
were  not  studies  with  persuasion  as  the  primary  goal.  *hile  1t  mignt  oe 
convenient  to  assume  tnat  similar  conclusions  could  oe  made  for  the 
impact  of  mediated  messages  on  a  student's  attitudes,  or  even 
psychomotor  skills,  the  summaries  of  research  reported  oy  Clark  do  not 
satisfactorily  document  this  position,   as  a  matter  of  fact,  there  1s 
some  evidence  that  there  is  a  hierarcny  of  preferred  media  types  when 
attitudinal  outcomes  are  of  primary  importance  Uimonson,  l*ou;  mager, 
ly/b),  and  tnat  the  media  type  used  to  deliver  persuasive  messages  is 
related  to  tne  impact  of  those  messages. 


HUKFUbl 


ltie  purpose  of  this  paper  will  be  to  report  the  results  of  five  studies 
that  attempted  to  answer  the  following  questions. 


1.  is  there  a  Hierarchy  of  media  types  reJateo  to 
effectiveness  at  delivering  persuasive  messages? 
In  other  words,  are  media  that  are  able  to  deliver 
messages  realistically,  as  defined  by  uale  U**oi, 
more  effective  than  media  that  depict  messages  less 
realistically? 

2.  Is  there  a  learner  aptitude  interaction  with 
media  type  when  attitude  change  is  the  goal  of 
instruction,    in  other  words,  do  the  learner 
characteristics  of  Meld  Uependence/Field 
independence,  and  Hemi sphericity  interact  witn 
media  type  when  persuasive  messages  are  delivered? 

j.  is  it  necessary  to  design  mediated  messages 
differently  for  learners  with  different  learning 
styles  when  persuasion  is  desired?  in  other  words, 
are  media  uniformly  effective  for  all  learners,  or 
are  there  different  "best"  designed  media  for 
different  groupings  of  students? 
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VAklAultS  utr  ifctu: 


The  five  studies  reported  ©elow  all  examined  tne  impact  of 
persuasive  messages.  Ihere  were  tnree  media  used  in  one  or  n<ore  of 
the  studies  to  deliver  treatments,    iney  were  motion  pictures, 
videotape  copies  of  wot  ion  pictures,  or  t  x  i  color  shoe  versions 
of  notion  pictures.  There  were  twj  cognitive  styles  included  as 
independent  variables  Uusourn  and  Ausourn,  197o).    they  were 
field  uependence/ Independence,  or  Hemi sphericity.  1  he  content  of 
experimental  treatments,  and  the  focus  of  tests  of  dependent 
variables  were  either  attitude  toward  soil  conservation,  attitude 


toward  smoking,  or  attitude  toward  disabled  persons. 


lrtUt.HtfcUt.riT  VAKlAoLU  UtKlwtu: 


Killu  ut HtnuthCt/ l^utHLMutNtt iKu/t- 1 ) :  f'u  and  n  are 
considered  to  be  pervasive,  staole  cognitive  styles 
ttiat  influence  a  person's  perception  of  messages 
(tMCieoo  et  al.,  1W»).  ru  learners  are  those  who 
are  influenced  more  by  tneir  environment  than  are 
H  learners  who  are  more  influenced  by  internal 
forces.  KU  individuals  seem  to  be  more  socially 
oriented,  and  are  more  -affected-  by  praise  and 
criticism  from  their  peers,   t'u  tend  to  taxe  a  more 
passive,  spectator  role  in  learning  than  do  fl 
learners  Uarrell,  19711  •  tl  learners,  on  the  other 
hand,  seem  more  adept  at  taxing  a  message  apart  and 
at  understanding  its  component  parts.  Fl  persons 
tend  to  be  more  active  learners  who  often  have  a 
strong  self  concept.  ' 

people  are  not  totally  rield  uependent  or 
Independent.   Kather,  they  have  tendencies  one  way 
or  the  other.   Kor  the  purposes  of  tne  studies 
reported  below,  the  faroup  tmbedoed  figures  lest 
tttU-T;  tfiuin  et  al.,  19/1)  was  used  to  identify  a 
person's  learning  style.   Subjects  for  study  were 
given  the  utM  in  a  standardized  testing 
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environment,  men  were  categorized  as  being  either 
r'U  or  Kl,  depending  on  their  score  on  the  utFl. 
since  this  test  provides  a  score  from  zero  to 
eighteen,  subjects  were  assignee  randomly  to 
treatments  by  ordering  them  from  lowest  score  to 
highest  and  by  using  a  table  of  random  numbers  to 
place  them  in  treatment  groups.   Students  who  had 
scores  within  one  score  of  the  average  of  all 
scores  were  not  included  in  treatments,   lhey  were 
excused  from  the  experiments  because  the  utFT  dio 
not  satisfactorily  identify  them  as  being  either  tu 
or  H  (Witkin  et  al,  19/1). 

HtnlSfhuilCHY:  Researchers  have  reported  that  in 
spite  of  a  great  deal  of  overlap  of  function,  tne 
two  hemispheres  of  the  brain  organize  and  encode 
information  to  two  different  ways  ISperry,  19/ /; 
dogen,  19/d).  Generally,  the  left  hemisphere  is 
more  logical,  convergent,  and  analytical.    It  is 
responsible  for  language  and  processes  information 
sequentially.  The  right  hemisphere  is  more 
holistic,  intuitive,  spatial,  and  divergent 
tornstein,  197/).  lhe  left  hemisphere  seen*  to 
perceive  relationships  across  time,  while  the  rignt 
hemisphere  specializes  in  data  that  is  significant 
across  space  Uebes,  19//). 

It  has  also  oeen  determined  that  individuals  tend 
to  have  a  dominant  hemisphere.  That  is,  one 
nemispnene  tends  to  take  priority  when  information 
is  processed.  It  has  been  proposed  that  this 
hemispheric  dominance  is  related  to  effective 
learning,    in  other  words,  how  a  person  perceives 
data  in  part  determines  now  much  is  learned. 

in  order  to  assign  suojects  to  treatments,  the 
Conjugate  Lateral  tye  movement  ICUH)  lest  was  used 
to  identify  a  person's  dominant  hemisphere  lUay, 
19b4  ).  -The  -UAif  4*-*fr  individually-admmistered 
test  tuat  requires  observations  of  a  subject's  eye 
movement  after  reflective  questions  are  asked  of 
them.  I  he  movement  of  the  eyes  in  this  kind  of  a 
situation  is  related  to  hemispheric  dominance.  The 
CUrt  Test  nas  a  reliability  of  .7b  lr«./e;  oaken 
and  Strayer,  197j), 

subjects  in  Study  #b  were  tested  using  the  LLtM  and 
were  assigned  to  treatment  groups,  individuals  wno 
did  not  have  a  clearly  dominant  hemisphere  as 
indicated  oy  the  CU«  were  excused  from  the 
experiment. 
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Three  dependent  variables  were  used  to  examine  research 
questions.  Three  studies  were  concerned  with  students' 
attitudes  toward  soil  conservation,   une  study  examined 
attitudes  toward  smoking,  and  one  study  investigated 
attitudes  toward  disabled  persons. 

l.rne  "Soil  Conservation  Attitude  lest"  was 
developed  by  cook  UWa),  ana  revised  by  Moock  u*ol). 
It  contained  twenty  four  statements  that  subjects 
reacted  to  using  a  five  response  I inert- type  scale.  The 
SCAT  was  reported  to  have  a  reliability  estimate  of  .ot> 
lr«.ttb;  kloock,  l^ttl | 

l.  lne  "bmoking  Attitude  bcale"  ibHS)  was  a  twenty-one 
item  measure  with  a  five  response  1  inert- type  scale,  'me 
SaS  had  a  reliability  estimate  of  .ob  ir«.ob;  oaer, 
A  god). 

j.  J he  "Attitudes  Toward  Ui sab led  Persons"  UIUH)  test 
was  a  twenty  statement  measure  with  a  six  level 
likert-type  scale.  The  Aluf  had  a  reliability  estimate 
of  .70  tr«.7b;  tucker  et  al.,  lWu). 


The  design  of  eacn  ot  the  five  studies  will  be  discussed  next,  lne 
specific  utilization  of  the  dependent  and  independent  variable 
defined  above  will  also  be  explained. 

i»tuoy  iti:  In  aiany  respects,  this  study  could  oe  considered  a  pilot 
oecause  treatments  ana  the  measure  of  the  dependent  variable  were 
used  experimentally  for  the  first  time.  However,  the  experimental 
design,  the  treatments,  and  the  measure  of  the  dependent  variable 
were  considered  to  be  of  high  enough  quality  to  allow  this  study 
to  be  considered  a  rigorous  one. 

J  here  were  four  treatments,  three  were  experimental  and  one  was  a 
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control,  J  he  three  experimental  treatments  were  based  on  a 
twenty-three  minute  persuasive  film  titled,  %e  Are  of  the  boil", 
it  was  designed  to  introduce  soil  conservation  practices  such  as 
conservation  tillage  to  the  audience,  and  to  convince  them  that 
these  practices  were  critical  ones. 

subjects  in  the  first  treatment  viewed  this  motion  picture, 
students  in  the  second  treatment  watched  a  2x2  slide  with 
accompanying  audio  tape  that  was  proouced  from  the  option  picture, 
bach  scene  in  the  film  was  analyzed  ana  the  key  still  picture  was 
copiea  and  made  into  a  slide.   The  film's  narration  was  copied 
onto  an  audio  tape,  when  students  viewed  the  shoes  they  were 
projected  using  a  dissolve  unit  and  two  carousel  slide  projectors. 

♦ 

students  in  the  third  experimental  treatment  only  listened  to  the 
won  on  picture's  narration.  »hey  aid  not  view  anything,  but  sat  in 
a  aarkeneo  room. 

* 

lhis  study  used  a  pretest,  posttest  control  group  design  (Campoell 
and  Stanley,  Ivo;  besign  f<>).  subjects  were  nigh  school  students 
in  a  medium  sized  city  in  the  midwest,  r'irst,  subjects  were 
administered  the  S>tAl  to  determine  their  attitude  toward  soil 
conservation,  then  subjects  were  ranaomly  assigned  to  one  of  the 
three  experimental  treatments,  or  to  the  control  group.  Treatments 
were  administered  approximately  one  ween  after  the  pretest.  Mfter 
treatments  were  viewed,  subjects  were  again  administered  tne> SwU . 
lhe  cnange  in  score  from  pretest  to  posttest  for  eacn  student  was 
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combined  with  others  ami  used  to  test  hypotneses. 

Subjects  also  rated  the  technical  quality  of  the  treatments. 
Ratings  were  nigh  anu  generally  equal,  lhe  group  tnat  only 
listened  to  the  narration  rated  their  experience  the  lowest  U.bl 
on  a  scile  of  i-b  witn  b  ■  excellent),  out  tnis  rating  was  not 
significantly  different  than  those  of  the  other  two  experimental 
groups'. 

c 

btudy  9'i.i  This  study  was  a  modified  replication  of  btudy  si*  there 
were  several  changes,  first,  the  design  was  a  post-test  only 
control  group  (Campbell  ano  Stanley;  Design  to).  Subjects, 

who  in  this  study  were  college  undergraduates,  were  randomly 
assigned  to  treatments.  SCmT  scores  were  compared  to  the  control 
group  in  order  to  test  hypotheses.  The  protest  was  omitted 
because  it  was  felt  this  would  minimize  the  influence 'of  testing 
bias.  Ml  so,  the  audio  only  treatment  was  cropped  from  the 
experimental  design.    The  three  treatment  groups  were  the  .group  ' 
that  watched  the  motion  picture,  the  group  that  watched  the  slide 
with  audiotape,  ano  the  control  group.  Additionally,  the  MAi, 
tne  measure  of  the  dependent  variable,  was  modified  slightly  for 
this  study  based  on  the  results  of  *tuoy  *1.    its  reliability  was 
.bs  ir».o:>J. 

V 

1 

*  f 

Tne  most  significant  change  from  btuoy  *l  was  the  Inclusion  of  the* 
independent  variable.  Meld  Dependence/ independence.  Subjects 
were  given /the  fcfcH  IWitkin  et  al.,  19/1  )3 before  assignment  to 

* 
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treatment  groups.   btr i  scores  were  rank  ordered  from  lowest  U 
score  of  one)  to  highest  lan  eighteen),  ^uojects  who  obtaineo 
scores  within  one  point  of  the  mean  of  all  scores  were  elimmatea 
trow  the  experiment  because  the  Utt-'i  aid  not  satisfactorily 
categorize  them  as.  beinj  either  Field  Dependent  or  Kiel  a 
Independent.  Assignment  of  subjects  to  treatment  groups  was  then 
completed  by  placing  the  subject  with  the  lowest  score  in  the  film 
treatment,  the  next  student  in  the  sliue  witn  audiotape  treatment 
awl  the"  next  student  in  the  control  group.    I  his  proceoure  was 
followed  until  all  subjects  were  assigned  to  one  of  the  three 
treatment; . 

mr 

btudy  til  Ihis  study  was  a  modified  replication  of  btudy  *t.  lnere 
were  taree  changes,   nrst,  the  topic  of  the  experimental 
treatments  was  changed,   a  film  titled  Mlne  kight  Approach"  was 
selected  by  a  jury  of  media  specialists  as  an  excellent  persuasive 
film.    Its  topic  was  the  employment  of  the  handicapped,  a  slide 
with  accompanying  audio  tape  was  produced  from  the  key  visual  of 
each  scene  of  the  film  in  a  manner  similar  to  how  the  slide 
treatment  was  pVoouced  for  btudies  *l  and       These  treatments 
were  judge!  by  experts  to  be  of  generally  equal  quality. 

Naturally,  since  the  topic  of  the  treatments  changed  the  test  of 
the  dependent  variable  had  to  be  changed  also,   a  standardized 
test  of  attitude  toward  disabled  persons  was  found  in  the  HthlAL 
p.tAi>JKtMtNli>  YtAKdUUk  Uurcs,  197ft).  1  he  "Attitudes  lowards 
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uisable^  Persons"  imIuh)  lest  was  used  to  measure  attitude  after 
treatments  were  administered.    The  mIUK  was  reported  to  have  a 
reliability  estimate  of  .A>  ir«./o;  Yucker,  l*/u) 

1 

Ine  secona  change  was  to  use  fifth  and  sixth  gr  le  students  as 
subjects.  Ihey  ranged  in  age  from  ten  to  thirteen.  Last,  a  follow 
up  testing  three  weeks  after  treatments  was  given  to  a  small 
sub- sample  of  subjects  to  determine  if  attitude  changes  produced 

t 

! 

by  the  treatments  per&isteo. 

Inus,  tne  post  test  only  design  for  this  study  nao  two  independent 

variables,  Meld  uepenoence  and  Treatment.    Ine  l  cell  by  i  cell 

\ 

design  had  three  treatments  (motion  picture,  slide  with  audio 
tape,  and  control  j,  and  two  levels  of  the  cognitive  style  Meld 
Dependence/ A noependence. 


*tudy  ff4*:  This  experiment  could  also  oe  considered  a  modified 
replication  of  Study  «i,  I  here  were  two  major  changes  made  to  the 
design  of  Study  #2  for  this  experiment.    Mrst,  junior  and  senior 
hiyh  school  students  were  used  as  subjects,    inese  students  ranged 
in  age  from  ij  to  lti,  and  attended  scrioo!  in  a  small  town  in  an 
agricultural  state  in  the  mi dwest . 

I  he  second  change  was  the  examination  of  the  independent  variable 
hemi sphericity  in  this  study  to  replace  Meld 
Dependence/ independence.  Subjects  were  fi  st  tested  using  the 
Conjugate  Lateral  tye  (Movement  lCLtH)\  test  to  determine  their 


dormant  brain  hemisphere.   Then  they  were  assigned  to  one  of 
three  treatment  groups,    ine  first  treatment  group  viewed  the 
persuasive  film  %e  Are  ot  the  Soil",  ine  seconu  group  watched  the 
slice  with  accompanying' audio  tape  version  ot  this  motion  picture. 
Ihe  last  group  was  a  control.  After  treatments  were  completeo.,  the 

was  administered.  This  study  used  a  two  ceil  Dy  three  cell, 
post  test  only  control  group  design. 

Study        This  experiment  took  a  slightly  different  approach  than 
tne  four  studies  discussed  above.  At  its  foundation  was  the 
principle  reported  by  Simonson  11*04),  and  Rogers  UWj),  that  use 
of  fear  may  be  an  effective  technique  for  attitude  Change 
especially  if  preventatives  or  prooabilities  of  exposure  to  the 
fear  provoking  event  are  included  in  the  message.    In  other  words, 
an  effective  persuasive  message  tnat  shows  the  dire  consequences 
ot  not  following  some  course  ot  action,  such  as  stopping  coking 
or  wearing  seat  belts,  can  be  made  more  effective  if  cures  tor  trie 
proolem  or  techniques  for  f»ow  to  change  oehavior  are  included  in 
the  message. 

Study  #d  used  a  two  cell  Dy  three  cell  post  test  only  control 
group  design.   Meld  uependence/ independence  was  an  independent 
variable,  and  the  college  students  who  participated  in  this 
experiment  were  tested  using  the  UtFl  and  assigned  to  one  of  the 
tnree  treatment  groups  just  as  they  were  in  Study 
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tx peri mental  treatments  were  cased  on  4  film  titled  "Tne  Feminine 
mistake",  a  li  minute  long  an ti -sworn ny  motion  picture  sponsored 
Dy  tne  American  Lancer  society.  This  film  was  selected  by  a  group 
ot  media  specialists  from  a  number  of  others  because  of  its  nigh 
quality.    Permission  was  obtained  from  tne  copyright  nolaer  to 
produce  two  fifteen  minute  videotape  versions  of  the  film,  ine 
first  version  showed  only  the  fear  provoking  scenes  included  in 
"The  Feminine  Mistake".   Narrated  oy  uonnie  Franklin,  star  of  the 
television  program  "one  bay  At  a  lime",  this  version  snoweo  scenes 
designed  to  scare  viewers  out  of  smoking.   These  scenes  included 
an  interview  of  a  young  woman  undergoing  chemotherapy  for  lung 
cancer,  sequences  showing  how  smoke  deteriorates  the  tissues  ot 
the  skin,  and  a  presentation  oy  a  doctor  of  tne  results  ot  meoical 
tests  that  demonstrated  the  effects  ot  cigarette  smoke  on  unborn 
children. 

The  second  fifteen  minute  videotape  version  included  the  most 
dramatic,  fear  provoking  scenes  used  in  the  first  version,  but 
also  included  about  five  minutes  of  information  on  how  to  stop 
smoking.  These  scenes  gave  information  on  smoker's  support  groups, 
ana  how  the  body  recovers  once  a  smoker  quits. 

Ine  two  versions  of  the  motion  picture  were  evaluated  several 
times  during  production.    They  were  also  evaluateu  oy  suojects 
during  the  experiment  and  in  all  cases  were  judged  to  be  ot 
generally  nigh  and  equal  quality. 
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after  treatments  were  administered,  suojects  completed  the  SmoKing 
Attitude  Scale  iSas;  oaer,  lvt>o J.  Ihe  S*S  was  reported  to  have  a 
reliability  estimate  of  .t*4  lr«.d4j. 


KtSuUS:  ihe  results  of  each  of  the  five  studies  will  be  presented 
in  turn,  then  the  implications  of  these  results  will  be  discussed. 

btudy  #i:  uescriptive  statistics  are  reported  in  laule  *i.  wmle 
some  changes  in  attitude  occurred,  there  were  no  statistically 
significant  results  founo.  Of  interest  was  the  large  dispersion  of 
scores  around  the  wean,    in  otner  words,  the  treatments  diu  not 
influence  students  uniformly.    Some  students  were  aftecteo 
consider aDly ,  and  some  were  not  influenced  at  all. 

in  retrospect,  it  was  decided  that  the  use  of  a  pretest  was 
prooably  not  a  good  idea.    Campbell  and  Stanley  Uift)JI  recommended 
the  posttest  only,  control  group  design  luesign  #oj  when  random 
assignment  of  suojects  to  treatments  was  possible.  Studies  U  - 
usea  uesign  to. 

\ 


iable  #1  Here 

 --   714 

ERIC  Hi 


Study  §d;  inscriptive  and  inferential  statistics  tor  Study  u  are 
reported  in  Table       Ihere  was  a  statistically  significant 
attitude  difference  reported  that  was  attributable  to  tne 
treatments.  I  he  average  scores  of  students  in  all  four 
experimental  treatment  cells  were  more  positive  towards  the 
importance  of  soil  conservation  tnan  were  the  scores  of  control 
suojects.  A  Duncan's  test  (Ferguson,  iwij  was  used  to  identity 
where  significant  oifferences  occurred  within  the  design,  and  it 
was  found  that  the  subjects  in  the  motion  picture  treatment  who 
were  identified  as  oeing  Meld  Independent  had  more  positive 
attitudes  than  did  suDjects  in  any  of  the  other  five  treatment 
groupings. 


fable  *t  here 


^tudy  ny.  Results  of  descriptive  ana  inferential  statistical  tests 
are  reported  in  Jables  fja,  and  *jd.  ihere  was  a  statistically 
significant  difference  in  attitude  attributable  to  treatments  and 
to  the  learner  cognitive  style  field  uependence/ independence. 
After  treatments  the  subjects  who  viewed  the  motion  picture- 
generally  had  more  positive  attituoes  toward  disaoleu  persons  than 
did  subjects  wno  watched  the  slide  with  audio  presentation, 
average  attitude  scores  of  subjects  in  one  of  the  two  experimental 


treatments  were  significantly  wore  positive  than  were  the  average 
scores  of  control  subjects. 

Average  scores  of  several  treatment  cells  deserve  note.  First, 
control  suojects  who  were  Held  Independent  were  general ly  wore 
positive  towards  disabled  persons  than  were  Held  uependent 
control  subjects.  Next,  three  ot  the  treatment  cells  (filw/rU, 
Mlm/H,  and  Slide/Hi)  had  approximately  equal  attitude  scores, 
unile  the  fourth  treatment  group,  tne  Field  uepenuent  students  who 
vieweo  the  slide  presentation,  had  significantly  less  positive 
attitudes  toward  the  oisahled  than  aid  any  of  the  otner 
experimental  groups.  It  appeared  that  there  was  an  interaction 
between  Meld  Uepenoence  and  treatment. 

This  study  added  a  dimension  not  included  in  the  other 

t 

i 

experiments,    lhree  weeks  after  treatments  were  administered, 
fifty  nine  of  the  suojects  were  randomly  selecteo  for  retesting. 
The  results  of  tnat  retesjtfng  are  reported  in  Taole'ff^o.  ihere 

were  no  significant  differences  found,  even  thougn  the  trends  of 

f 

scores  were  similar  to  those  ohtaineo  from  the  original  ' 

9 

administration  of  tne  attituae  test,  Hiuf.  There  seemed  to  oe  a 
regression  to  the  mean  effect  taxing  place  i Campbell  ana  Stanley, 
iirtoj.  it  was  also  apparent  that  Field  independent  subjects 
generally  were  more  positive  towards  disabled  persons  than  were 
Field  Uependent  suojects.  because  such  small  numbers  of  subject, 
were  included  in  this  retesting  it  is  impossible  to  ojcaw" 
generalizable  conclusions  trow  the  data.  Lerteinly,  additional 


f 


research  with  full  scale  retesting  ot  subjects  is  necessary. 


Table  Jh  Here 
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Study  *<+:  Kesults  of  tests  to  provide  descriptive  statistics  are 
reported  in  lab'w  #4.  There  were  no  statistically  significant 
differences  found,  although  the  trends  of  the  mean  scores  were 


interesting.  Left  Drain  dominant  subjects  were  generally  more 
positive  than  were  right  brain  subjects  in  all  treatment 
categories. 

In  order  to  examine  the  data  more  completely,  an  analysis  of  iCM 
scores  for  subjects  in  grades  9  through  it  was  conducted.  While 
results  were  not  significant,  it  was  found  that  subjects  in  the 
higher  graces  who  were  in  experimental  treatments  had  more 
positive  attitudes  when  their  scores  were  compared  to  control 
subjects  in  the  same  grade.  In  other  words,  the  difference  between 
control  group  subjects'  and  experimental  group  subjects'  attitude 
scores  were  greater  in  the  higher  grades  than  they  were  in  the 
lower  grades. 


Table  *«  Here 


itudy  fb:  Results  of  descriptive  and  inferential  tests  are 
reported  in  table  fb.  It  was  found  that  both  experimental 
treatments  were  successful  at  significantly  influencing  subjects' 
attitudes  toward  swelling.    In.  other  words,  subjects  in  botn 
versions  of  the  videotaped  adaptations  of  "The  i-'eminine  Mistake" 
had  ntp re. negative  attitudes  towards  smokino  after  viewing 
treatments  than  did  control  subjects. 

while  the  scores  obtained  from  subjects  who  viewed  the  two 
experimental  treatments  were  not  significantly  different  from  one 
another,  the  trends  of  scores  did  support  the  assumption  that  fear 
provoking  messages  that  also  included  remedies  for  the  problem 
discussed  in  the  message  would  oe  more  persuasive  than  would  be 
those  that  only  presented  unpleasant  information.^! here  was  no 
statistical  difference  reported  between  the  levels  of  the 
independent  variable  Field  Dependence/ Independence,  nor  was  there 
a  significant  interaction  between  Held  Dependence  and  Treatment. 


ul&ubbiofc: 
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ihis  discussion  of  the  results  of  these  five  studies  will  be  * 
segmented  into  three  parts,  rirst,  the  three  experimental 
questions  proposed  above  aoout  the  relationship  between  attitude 
change,  media,  and  learning  style  will  oe  examined.  Next,' 
additional  research  needed  in  this  area  will  oe  identified,  and 
last,  a  summary  of  the  significance  of  these  studies  will  Oe 
presented.  -  $ 

Research  Questions:  * 
tarlier,  three  Specific  questions  were  posed  that  served  as  guides 
for  design  of  the  five  studies.  The  relationship  between  the 
results  of  the  five  studies  to  these  research  questions  will  oe 
discussed. 


question  #i.  Is  there  a  hierarchy  of  media  types  related 
to  effectiveness  at  delivering  persuasive  instructional 
messages?  % 


Hrst,  it  must  be  stated  tnat  no  experiment  "proves"  anything. 
Results  must  be  interpreted  in  light  of  limitations  of  tne  design 
of  the  study,    tven  when  the  general  structure  of -an  experiment  is 
replicated  several  times  as  was  attempted  here,  it  is  important 
not  to  become  overconfident  that  results  are  general izabie  in  all 

4 

instances.  Certainly,  readers  of  this  report  must  evaluate  it  with 
a  healthy  skepticism.   However,  it  does  seem  obvious  that  media 
can  oe  used  lo  deliver  persuasive  messages,  a  nay  It  is  also 
oovious,  though  to  a  lesser  degree,  that  media  that  depict 

W  749 


oiessages  more  realistically,  such  as  motion  pictures,  are  somewhat 
better  at  changing  attitudes  than  are  media  that  oellver  messages 
less  realistically. 

The  impact  of  realistic  persuasive  messages  on  attitude  change  nas 
been  studied  by  psychologists  tor  over  two  decaoes.  Reinforcement 
lheory  1s  based  on  the  assumpti^..  that  realistic  messages  have 
more  cues  tor  the  viewer,  and  thus,  are  more  effective  at 
persuading  iHovland,  lfcul).  ine  results  of  these  stuoies  seem  to 
support  tiie  assumptions  of  this  theory.  I  he  persistence  of  change 
produced  in  learners  because  of  participation  in  experimental 
treatments  is  less  obvious  ami  in  need  of  additional  scientific 
inquiry. 

t*.  Is  there  a  learner  aptitude  interaction  with  media 
*        type  when  attitude  change  is  the  goal  of  a  message? 

Based  on  the  results  ot  Studies  #2  and  §<S,  there  seems  to  be  a 
relationship  between  Field  lndepenoence  ano  persuasive  messages 
presented  oy  film,  while  it  may  be  that  films  are,  in  general, 
better  than  slide  presentations  at  changing  attitudes,  this  say  be 
because  Held  lnaependent  learners  are  influenced  considerably 
more  than  are  Held  dependent  viewers.  It  also  seems  that  for  the 
attitude  constructs  investigated  by  these  studies,  Held 
Independent  persons  had  more  positive  attitudes  about  tnem  to 
begin  with,  tvidence  for  this  generalization  can  only  be  inferred 
from  the  statistical  results  reported  above.  Lertainly,  more  study 
is  needed.  p 
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wv  Is  it  necessary  to  design  mediated  messages 
differently  tor  learners  with  different  learning  styles 
when  persuasion  is  desired/ 


Uatd  related  to  this  research  question  is  the  most  difficult  to 
inter  from  the  information  reported  aoove.   While  it  might  be 
convenient  to  assume  than  motion  pictures  work  oetter  tor  all 
subjects  generally,  and  best  for  Field  Independent  subjects 
specifically,  as  Studies  fi  and  §s  seem  to  indicate,  and  that 

hewi sphericity  is.  not  related  to  attitude  change,  as  the  results 

« 

of  Study  #b  seems  to  indicate,  these  generalizations  would  be 
subject  to  justified  skepticism.  Oilier  equally  interesting,  but 
conflicting  interpretations  ratgns  also  oe  drawn  from  the  aata. 
For  example,  the  results  of  Study  *b'  seem  to  indicate  that  left 
brain  dominant  teenagers  tend  to  be  more  positive  generally  toward 

the  need  tor  soil  conservation,  and  that  they  are  influenced  more 

t 

oy  a  slide  presentation  than  they  are  by  a  motion  picture,  wmle 
tnis  kind  of  conclusion  might  seem  logical  oased  on  what  is  known 
about  the  sequential ,  logical  manner  that  left  brain  dominant 
persons  seem  to  favor "when  they  process  information,  the  results 
of  Study  tb  are  not  statistically  significant  and  do  net  allow 
generalizations  of  this  kino.   As*is  often  the  case,  experimental 
research  presents  as  many  questions  as  it  answers. 

* 

Suggestions  for  Additional  Research: 

one  often  stated,  and  valid  criticism  of  educational  research  is 
the  failure  of  investigators  to  replicate  the  work  of  others. 
Certainly,  Studies  and  #6  should  be  replicated. ^Modified 


J 

replications,  those  studies  than  Imitate  roost  Out  not  ell  of  the 
design  parameters  of  a  previous  study (  are  neeoeo  also,  cor 
example,  Study  #>,  an  experiment  that  used  attitude  t.  jurd 
disabled  persons  as  Its  dependent  varlaole,  could  oe  replicated 
using  other  age  groups,  ami  possibly  another  learning  style  as  an 
independent  variable.  Also,  Study  tb  could  oe  replicated  using  a 
different  age  group,  or  with  the  same  age  group  but  with  a 
different  dependent  variable.  In  other  words,  a  mosaic  of  many 
studies  dealing  with, the  general  research  questions' posed  above  > 
are  required  before  global  generalizations  are  made. 

Suninary  of  Conclusions: 

a  fundamental  assumption  of  the  research  presented  above  was  that 
attitude  change  was  an  important  concern  of  the  educator.  Since 
attitudes  are  predispositions  to  respond,  and  because' some 
evidence  is  now  being  reported  that  relates  attitudes  to 
behaviors,  the  modification  of  attitudes  was  considered  a 
worthwhile  experimental  endeavor^    host  obvious  oy  its  omission 
from  the  five  research  designs  discussed  in  this  report  was  any 
examination  of  attitude  position  to  related  behavior.  In  other 
words,  there  was  no  study  of  subjects'  actions  after  their 
attitudes  were,  successfully  modified,   uio  soil  conservation 
improve?  uio  cigarette  smoking  decrease?  ind  interaction  with 
disabled  persons  increase?  white  there  is  some  evidence  in  tne 
literature  that  the  modification  of  attitudes  will  change 
subsequent  benaviors  (Simonson,  1W7),  these  relationships  requi 
considerable  more  study. 


It  is  also  i  Alport  ant  not  to  overlook  wnat  ooes  seem  to  oe 
supported  by  the  results  ot  the  five  studies  presented  in  tins 
report.  Virst,  attitudes  toward  educationally  relevant  topics, 
such  as  conservation,  smoking,  ana  disabled  persons,  can  oe 
modified  fry  using  persuasive  messages  delivered  oy  media.  *«ext,  it 
appears  that  some  types  of  media  may  be  wore  effective  than  others 
at  delivering  information  designed  to  change  attitudes,   ration  * 
pictures  seem' the  most  effective,  possibly  because  tne  film  medium 
presents  information  most  realistically.    There  also  seems  to  oe 
sufficient  evidence  to  warrant  further  investigation  into  the 
relationship  between  persuasive  messages,  media  used  to  deliver 
those  messages,  and  the  learning  styles  of  the  target  audience. 
Clark's  comparison  of  media  to  delivery  trucks  may  be  safe  and  it 
not  supportable,  at  least  difficult  to* refute.  However,  it  may  not 
be  totally  accurate,  especially  when  the  products  delivered  are 
cartons  of  attitude  rather  than  crates  ot  achievement. 
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Table  1.    Descriptive  Statistics  for  Study  #1 


TREATMENTS 


Motion 
Picture 

Slides 
vith  Audio 

Audio 
Onty 

Control 

TOTAL 

N 

AO 

-49 

43 

43 

175 

Xa 

•v  +.37 

+1.65 

-.08 

-.52 

+.38 

SD 

 m>l  

9.3X  • 

*  • 

8.34 

8.29 

8.73 

f 

8.65 

Xa  -  average  change  between  pre-  and  post-test  (higher  positive  number 
indicates  positive  change  toward  soil  conservation) 
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Table  2.    Descriptive  and  Inferential  Statistics  for  Study  #2 

 j  \  

A.    Descriptive  statistics  \ 

Treatment 


Film 

sjLidis 

Corit  roJ 

Total 

Field  dependent 

Xa- 

64.69 

X  - 

65. 

33 

X  * 

61 

14 

X  - 

63 

.62 

subjects 

N  - 

13 

N  - 

12 

N  - 

N  - 

39 

SD- 

6.76 

SD  -  7. 

39 

SD  ' 

-  8. 

47 

SD  -  7 

.64 

Field  independent 

X  « 

69.86 

X  - 

65. 

31 

X  - 

6i 

69 

X  - 

66 

.19 

subjects 

N  - 

14 

N  - 

13 

N  - 

16; 

N  - 

43 

SD- 

4.85 

SD- 

7. 

96 

S!>- 

7. 

95 

SD« 

7 

.42 

Total 

X  - 

67.3? 

X  - 

65. 

32 

X  - 

62. 

50 

X  - 

64 

.96 

N  - 

27 

N  - 

25 

N  - 

30 

N  » 

82 

SD« 

6.31 

SD- 

7. 

53 

SD« 

8. 

16 

SO* 

7 

.59 

B.    Multiple  analysis  of  variance 


Source 

SS 

OF 

NS 

F 

Sign,  of  F 

Maii«  effects 

482.45 

3 

160.82 

2.98 

.04* 

Treatment 

34  7 .  30 

2 

1 73.65 

i.  22 

.  05* 

Field  dependence 

140.80 

1 

140.79 

2.61 

.11 

Interaction 

87.37 

2 

43.69 

.81 

.45 

Explained 

569.82 

5 

11,3.96 

2.11 

.07 

Residual 

4097.05 

76 

53.94 

Tni3l 

4666.88 

81 

57.62 

 .  1 

*p<.05.  I 


Xa  ■  Higher  scores  indicate  a  more  positive  attitude  toward  soil  conservation. 
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Table  3A.    Descriptive  and  Inferential  Statistics  for  Study  93 


A.    Descriptive  statistics 

Treatment 


F118I 

Slides 

Control 

Total 

Field  dependent 

Xa-  86.08 

X  • 

75.25 

X 

«  67.83 

X 

■  76.64 

subjects 

■  72 

§  fa 

N  a  25 

24 

N  ■ 

N 

•1 

SD  *  14  61 

SD  • 

18.% 

SD 

-  21.29 

SD 

-  19.65 

Field  Independent 

X  «  85.17 

A 

87.24 

I 

X 

■  83.50 

subjects 

-  68 

N  *  74 

21 

N  - 

N 

14.55 

SD 

•  16.38 

SD 

-  16.28 

1 0 1  c  1 

X  ■  85.63 

A 

80.84 

i 

X 

»  79.97 

N  =  49 

45 

N  * 

•ff  u 

N 

«  140 

cn  a  15  A7 

17.91 

SC 

*  19  52 

SO 

«  18.35 

B.    Multiple  analysis 

of  variance 

Source 

ss 

MS 

F 
• 

Sign,  of  F 

na  i  n  enec  ts 

3 

1829.94 

6.11 

.001* 

Treatnent 

38*3.53 

2 

1921.77 

6.41 

.02* 

Field  dependence 

'17C4.87 

1 

1704.87 

5.69 

.002* 

Interaction 

1188.08 

2 

594.04 

1.98 

.14 

Explained 

6677.86 

5 

1335.58 

4.46 

.001* 

Residual 

40150.01 

134 

299.63 

Total 

46827.89 

139 

356.89 

*p  <  .05. 

Xa  -  Higher  sqores  indicate  a  aore  positive  attitude  toward  disabled  persons. 
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Table  3B.    Retest  Descriptive  and  Inferential  Statistics  for  Study  #3 


A.    Descriptive  statistics 


Treatment 


Film  r 

Slides 

Control 

Total 

Field  dependent 

Xa«  .82.00 

X  * 

71.25 

X 

s 

74.45 

\  ■'75.96 

subjects 

N  =  9 

N  » 

8 

N 

* 

11 

N  *  28 

SO  =  20.54 

SD  « 

22.19 

SD 

m 

J5.91 

SD  *  19.14 

Field  independent 

X  =  78.00 

x  = 

89.00 

X 

» 

86.60 

X  *  84.68 

subjects 

N  =  10 

ii  = 

U 

N 

10 

N  -  31* 

SD  =  23.88 

SD  - 

18.00 

SD 

s 

15.13 

SD  ■  19.25 

Total 

X  =  79.89 

X  * 

81.53- 

X 

2 

80.24 

X 80.54 

N  =-19 

N  * 

19 

N 

8 

21 

» 

N  s  59 

SD  =  21.84 

SD  = 

21.27 

SD 

/ 

S 

16^8 

-SO  =  19.53 

B.    Mul tiyie  analysis 

of  variance 

i 

Source 

S3 

DF 

MS 

F 

Sign,  of  F 

Main  effects 

1130.49 

3 

376.83 

1.01 

0.40 

Treatment 

13. *9 

2 

$.79 

.018 

0.98 

field  dependence 

1102.19 

1 

1.102. 

19 

2.95 

0.09 

Interaction 

1205.52 

2 

602. 

76 

1.61 

0.21 

Expla  in«d 

2336.02 

5 

476.20 

r 

1.25 

0.30. 

Residual 

r 

19790.63 

53 

373. CI  , 

Total 

22126.64 

58 

381.49 

Xa  -  Higher  scores  indicate  a  nsore  positive  attitude  coward  disabled  persons. 
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Table  4.    Descriptive  Statistics  for  Study  #4 

TREATMENT 


Film 

Slides 

Controls 

TOTAL 

Right  Brain 

Xa-57.26 

X-57.47 

X-55.56 

X-5N.81 

\ 

Dominant 

N-19 

N-17 

U-16 

N-52 

Learner 

SD-8.26  ' 

SD-Hv35 

SD-9.80 

SD-9.65  • 

*  Left  Brain 

X-59.78 

X-60.64 

X-57.29 

X-59.02  ' 

Dominant 

N-18 

N-14 

N-21 

N-53 

Learners 

<5D«11.38 

Sp-7.58 

sy-7.76 

SD-9.02 

Total 

X-58.49 

X-58.90 

JC-56.54 

X-57.92 

N-37 

N-31 

N-37 

N-105 

SD-9.84 

SD-9.81 

SD-8.54 

SD-9.36 

Xa  *  Higher  number 
conservation* 

indicates  a  more 

positive  attitude  toward 

soil 

9 

•ERIC 
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*Table  5.    Descriptive  and  Inferential  Statistics  for  Study  #5 


A.   Descriptive  statistics 


 Treatments  ; 

Fear              Fear  with 
alone '  alleviation  Control 


Field 

Xa- 

38.93a 

41.23 

47.50 

> 

dependent 

c 

SD 

7.78 

11.67 

6.76 

group 

N 

* 

1.5 

22 

14 

Field 

X 

39.85 

40.21 

48.32 

independent 

SO 

10.87 

8.95 

13.16 

group 

N 

20 

24 

22 

B.    Multiple  analysis  of  variance  -  treatment  by  level 

Source 

O.F. 

SS 

MS 

F 

P 

Main  effects 

3 

1562.56 

520.85 

4.810 

0.003* 

Treatment 

2 

1554  .  52 

777.26 

7.170 

0.001* 

Level 

1 

0.35 

0.35 

0.000 

0.960 

Interaction 

2 

24.50 

12.25 

0.133 

0.890 

Explained 

5 

1587.06 

317.41 

2.930 

0.020 

Total 

116 

13614.47 

 %  

Xa  -  Higher  scores  indicate  a  more  positive  attitude  towards  smoking. 
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SUPPLANT  AT  ION  MODEL  VERSUS  GENERAT I VE  MODEL: 
IMPLICATIONS  FOR  DESIGNERS  OF  INSTRUCTIONAL  TEXT 

During  the  1984  AERA  conference  In  New  Orleans,  I  attended  a  session 
("Learner  Aspects  of  Human  Thinking")  in  which  participants  addressed  the 
potential  of  training  students  to  use  metacognitive  strategies,  Some  of 
the  ideas  expressed  during  that  session  suggest  a  line  of  contemplation 
and  research  that  I  want  to  briefly  discuss  with  ybu  today.  This  line  of 
inquiry  seems  to  be  of  particular  value  because  it  rather  epitomizes  the 
point  to  which  the  field  of  instructional  technology  appears  to  have 
evolved 

The  presenters  in  the  AERA  session  discussed  the  efficacy  of  teaching 
students  strategic  behaviors,  such  as  cognitive  monitoring,  rehearsal,  and 
self  questioning.  My  attention  was  particiiiarlydrawn  by  one  of  the 
discussant's  comments.  Dr.  Gagne'  suggested  that  we  consider  an 
alternative  to  metacognitive  training.  This  alternative  is  "building  the 
strategies  into  the  instructional  materials  rather  than  into  the  learners." 
Implicit  in  his  response  was  the  issue  as  to  whether  It  is  more  efficient 
and  effective  to  train  ^tudents  in  metacognitive  strategies  or  to  include 
within  instruction  conventions  and  cues  that  preclude  the  heed  for 
strategy  use. 

This  question  interested  me  because  it  seems  that  instructional 

I  * 

technologists  opt  for  the  approach  of  "building  the  strategies  Into  the 
materials  rather  than  into  the  learner  quite  often  as  we  design,  develop, 
and  produce  instructional  materials.  1  do  not  think  we  have  seriously 
investigated  the  pros  and  cons  of  operating  under  such  a  model.  Wtth  the 
current  willingness  in  our  field  to  look  inside  the  "black  box"  of  cognitive 
processing  (Bovy,  1981;  Bruning,  1983;  Winn;  1982)  such  an  investigation 
appears  to  be  timely.  <^gj  . 
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In  my  discussion  today,  I  am  going  to  label  the  design  alternative  of 
"building  the  strategies  into  the  materials"  as  a  stmniantahon  model  for 
designing  instruction  (Ausburn  &  Ausburn,  1978).  The  model  of  "building 
the  strategies  into  the  learner"  I  win  label  as  a  generative  model  of 

♦ 

design.  These  contrasting  models  of  design  represent  the  extpemes  of  a 
continuum  that  illustrates  the  ratio  of  the  amount  of  processing  support  • 
provided  by  the  instruction  to  the  amount  of  cognitive  elaboration  required 
of  the  learner..  There  are  advantages  and  disadvantages  of  each  model  and 
conditions  under  which  each  might  be  appropriate.  Within  this 
presentation  1  would  like  to  do  three  things:'  a)  describe  the  two  models 
more  completely,  b)  suggest  a  line  of  research  investigating  the 
conditions  under  which  each  model,  or  when  compromises  between  the  two 
models,  might  be  appropriate,  and  c)  relate  all  this  to  the  philosophical 
questions  that  seem  to  be  arising  in  our  field. 

In  my  discussion  I  will  use  examples  from  the  design  of  instructional 
print.  This  is  the  medium  which  holds  the  greatest  interest  for  me  at  the 
moment.  However,  I  feel  that  the  issues  which  We  will  examine  extend 
beyond  the  qualities  of  any  one  medium.  ^} 

c 

Supplantation  Mwtel  of  Design  < 

A  supplantation  model  of  design  (Ausburn  &  Ausburn,  1978)  "builds  the 
strategies  into  the  instructional  materials  rather  than  Into  the  learner."  ^ 
An  instructional  designer  operating  under  this  model  would  see*j4p  . 
identify  the  information  processing  demands  o?  a  learning  task  and 
perform  those  transformations— to  a  greater  or  lesser  extent— for  the  r 
learners.  When  Ausburn  and  Auburn  spoke  of  the  supplantation  model  of 
design,  they  added  the  condition  that  the  sufipiantation  in  the  instructional 
mater  ils  would  perform  only  those  Information  processing  requirements 
for  the  learner  that  the  learner  1s  unable  to  supply  for  himself.  I  suspect 
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that  instructional  designers,  in  an  attempt  to  make  instruction  as 
unambiguous  and  efficient  as  possible  for  the  learner,  may  supplant  some 
processing  that  the  learner  may  actually  be  able  to  supply  for  himself. 

The  term  supplantation  seems  to  have  come  from  Salomon  (1979)  who 
used  it  when  describing  the  role  of  a  zoom  TV  production  technique. 
Students  in  his  study  were  to  complete  a  task  which  required  attention  to 
particular  visual  cues.  Salomon  conjectured  that  zooming  in  on  relevant 
•portions  of  a  visual  field  would  supplant  the  processing  requirement  of 
selecting  pertinent  cues  from  a  field  of  many  v^ual  stimuli.  He  found,  in 
fact,  that  this  zooming  did  improve  task  performance  for  learners  with  v 
low  cue  attendance  skills;  however,  such  supplantation  depressed  the 
performance  of  high  cue  attenders.-  Other  studies  investigating  the  effects 
of  supplantation  have  found  that  suppTantation  techiques  can  aid  haptic 
learners  in  tasks  requ i  ri  ng^compari s^ns  of  visual  images  ( AusJ^rn,  1 975) 
and  field  dependent  learners  in  a  task  requiring  the  disembedding  of  a 
visual  stimulus  from  a  complex  field  of  visual  stimuli  (Konkiel,  1981 ). 

Allow  me^give  some  specific  examples  of  the  supplantation  model  of 
design  from  the  field  of  instructional  print  design.  When  designing 
instructional  print,  whether  intentionally  or  by  convention,  we  use  a 
/dumber  of  tecjwquesto  supplant  some  of  the  processing  requirements  of 
the  "reading  to  learn"  task.  In  a  very  fundamental  sense,  the  task 
requirements  of  processing  instructional  text  might  be  described  as  a) 
perceiving  and  decoding  graphemic  symbols,  b)  directing  attention  to 
important  portions  of  t{*e  text  (selective  perception),  c)  organizing  the 
concepts  presented  in  the  text  in  a  form  that  can  allow  for  encoding  new 
'information  Into  existing  cognitive  structures,  and  d)  retrieving  and 
maintaining  in  working  memory  new  Information  plus  relevant 
information  from  existing  cognitive  structures. 
These  text  processing  requirements  can  be  partially  supplmfyJ  through 
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the  use  of  text  design  convent  tons.  F  dr  instance,  in  order  to  support  the 
perception  of  graphic  symbols,  the  text  designer  uses  typography  with  the 
high  visibility  and  layout  that  includes  adequate  leading  and  line  length. 

« 

Decoding  is  supported  by  the  use  of  high  frequency  vocabulary  (Glynn  & 
Britten,  1984).  The  designer  may  direct  the  reader's  attention  to 
information  that  she  considers  to  be  pertinent  to  the  learning  task  by 
including  instructional  objectives,  by  providing  typographical  cues  such 
as  bullets,  boldface  type,  italics,  or  underlining;  and  by  adding  summaries, 
overviews;  or  prequestions.  The  text  processing  requirement  involving 

development  of  jan  organizational  scheme  may  be  supplanted  through  the 

f 

provision  of  headings,  outlines,  marginal  notes,  or  formatting  techniques 
such  as  information  mapping  (Horn,  1976)  or  discourse  punctuation 
(Showstack,  1982.  Text  designers  may  aid  learners  to  encode  new. 
information  into  their  existing  cognitive  structures  (to  integrate  new 
information  wfth  prior  knowledge)  through  the  use  of  advance  organizers, 
adjunct  questions,  and  analogies  (Glynn  &  Britton,  1984).  The  need  to 
establish  retrieval  cues  for  future  recall  may  be  somewhat  supplanted  by 

i 

the  provision  oif  access  structures  such  as  headings,  marginal  notes,  and 
outlines.  Finally,  the  demands  of  maintaining  much  information  in  working 
memory  may  be1  somewhat  ameliorated  through  the  use  of  chunking,  lists, 
diagrams,  charts,  and  verbal  summaries. 

As  text  designers  we  incorporate  many  of  these  processing  surrogates 
in  our  mateTialJs.  1  suspect  this  will  continue  to  be  the  case.  However, 
there  are  sufficient  equivocal  research  findings  regarding  the  efficacy  of 
such  conventions  ( for  example  Christensen  &  Stordahl,  1953;  Hartley, 
1980;  Hoi  ley,  1980,  Klare,  bnuford  &  Nichols,  1958;  Marshall  &  Slock,/ 
1975,  Meyer,  1975;  Smith,  1983)  for  us  to  investigate  the  conditions  untfer. 


which  such  conventions  promote  learning  and  when  they  may  actually  have 
deleterious  effects,  (toe  hypothesis  to  account  for  these  equivocal  results 
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is  that,  for  some  learners1,  in  some  learning  tasks,  and  under  some 
conditions,  the  provision  of  such  embedded  strategies  may  short-circuit 
(Salomon,  1979)  the  depth  of  processing  required  for  the  achievement  of 

« 

learning  outcomes.  Perhaps  the  inclusion  of  organization,  emphasis,  and  * 
retrieval  cues  not  only  fails  to  encourage  the  learner  to  make  those 
elaborations  (ties  between  prior  and  new" learning)  necessary  for  learning 
to  occur,  but  also  may  actually  inhibit  the  learner  In  doing  these  things.  In 
the  past  tew  years,  considerable  attention  has  been  given  to  the  allegation 
that  the  |u.  plantation  of  processing  may  actually  be  deleterious  to 
learnin|j(B0vyf  1 98 1 ;  Salomon,  1 979,  Wi  ttrock,  1 979). 
wntcn  brings  us  to  an  alternative  model ^of  design. 

Generative  Model  of  learning 

A  contrasting  design  model  can  be  derived  from  Wittrock's  ( 1 974) 
generative  model  of  learning.  The  generative  model  predicts  that  the 
greatest  learning  will  o&ur  when  students  construct  tdiosycratic  ties 
between  the  instructional  stimulus  and  their  current  cognitive  structures. 
A  designer  operating  under  this  model  might  view  as  her  responsibility  the 
construction  of  instructional  sequences  that  will  stimulate  (or  allow) 
learner?,  to  generate  their  own  idiosyncratic  transformations  of  incoming 
information.  Such  instruction  allows  for  active  construction  of  meaning 
and  is  presumed  to  support  the  depth  of  processing  needed  for  optimal 
learning. 

There  are  at  least  two  tactics  available  to  the  designer  who  is 
operating  under  the  generative  model.  She  may  attempt  to  direct 
generation  of  cognitive  elaborations  (for  example  by  suggesting  that 
learners  create  their  own  summaries  of  an  instructional  passage),  or  she 
may  simply  refrain  from  supplying  surrogates  and  allow  for  spontaneous 
use  of  a  cognitive  strategy  that  learners  have  already  acquired(  e.g.',  the  . 
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creation  of  their  own  summaries,  outlines,  or  notes). 

A  text  designer  who  is  following  a  generative  model  of  design  may 
either  direct  or  aWow  readers'  text  processing  through  a  number  of 
devices.  A  desr    may  direct  generative  decoding  by  including  adjunct 
questions  that  require  students  to  attach  meaning  to  graphic  symbols.  The 
instructional  text  may  suggest  the  use  of  generative  attention-directing 
techniques  such  as  underlining,  circling,  boxing,  labeling,  or  drawing 
arrows.  Or  the  text  designer  may  simply  allow  students  to  spontaneously 
generate  such  cues  for  themselves.  Students  may  be  prompted  to  utilize 
such  organization  strategies  as  outlining;  developing  headings,  labels,  or 
keywords;  making  marginal  notes;  or  creating  webs,  networks,  or  pattern 
notes  (Fields,  1982).  Encoding  may  be  facilitated  through  such  generative 
processes  as  answering  application-level  adjunct  questions,  creating 
analogies,  writing  summaries,  or  developing  illustrations.  Readers  may 
establish  their  own  retrieval  cues  with  the  attention-directing  strategies 
such  as  underlining,  boxing,  and  labeling.  Finally,  students  may  devlop 
their  own  strategies  to  accommodate  the  limitations  of  memory  by 
generating  mnemonics,  diagrams,  and  setting  up  retrieval  schemes. 

Verbal  learning  studies  suggest  that  stimulus  materials  that  require 
generation  of  elaborations  rather  thai  supplanting  such  processing  may 
lead  to  superior  learning.  Students  appear  to  comprehend  and  remember 
better  when  they  are  required  to  generate  their  own  underlining  (Rlckards 
&  August,  1975);  drawings  (Bull  &  Wittrock,  1973),  healings  (Ooctorow, 
Wittrock,  &  Marks,  1978),  organizers  (Wittrock,  1974),  and  questions 
(Frase  &  Schwartz,  1975)  rather  than  having  these  processing  supports 
provided  for  them. 

Research  literature  includes,  however,  those  studies  that  do  not  find  a 
superior  effect  of  learner-generated  elaborations.  A  study  by  Dee-Lucas 
and  DiVest3  (1980)  indicated  that  learners  who  generated  topic  sentences, 
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headings,  or  related  sentences  performed  no  better  than,  and  in  some  cases 

to 

not  as  well  as,  those  learners  who  had  these  cues  provided  for  them. 
Doctorow,  Wlttrock,  and  Marks  ( 1 978)  found  that  a  combination  of 
text-supplied  plus  learner-generated  elaborations  were  superior  to  either 
textual  cues  or  learner  elaborations  alone  in  facilitating  recall  and 
comprehension. 

Directions  for  Future  Research 

■  Of  course  it  is  not  a  question  of  which  model—the  supplantation  or  the 
generative— should  be  used  by  designers  and  developers.  None  of  us  would 
wish  to  design,  much  less  attempt  to  learn  from,  instruction  which 
Contains  no  processing  cues.  At  the  same  time,  we  have  all  heard 
students,  particularly  good  students,  grumbling  about  "predigested  pap"  or 
had  the  sense  that  something  about  our  designs  do  not  elicit  maximum 
eftort  from  our  students.  We  need  empirical  data  to  help  us  Identify  the 
conditions  which  prescribe  the  balance  between  these  two  models. 

The  conditions  that  prescribe  the  selection  of  a  design  model  go 
beyond  the  most  commonly  mentioned  determining  factor  —  whether  • 
learners  have  the  processing  skills  required  of  the  task^pr  not  (Bovey, 
1 98 1 ).  The  conditions  that  define  an  optimal  balance  between  the  models 
may  arise  from  the  nature  of  the  learner,  the  nature  of  the  learning  task, 
the  nature  of  the  instructional  environment,  and  interactions  of  these 
variables.  For  example,  investigations  searching  for  this  balance  must  go 
beyond  examining  learners'  characteristics  such  as  prior  knowledge  of 
content,  available  cognitive  strategies,  and  general  ability  to  suth 
attributes  as  achievement  motivation  and  personal  learning  objec.  es. 
For  example,  one  can  imagine  instances  when  instruction  designed  under  a 
supplantation  model  that  provides  the  processing  to  aid  learners  to  attain 
a  specified  goal,  may  be  deleterious  if  a  learner  enters  the  instruction 
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with  other  leaning  goals  in  mind  ■ : 

m 

When  considering  the  variable  of  task  characteristics,  while  we  must 
continue  investigations  into  the  information  processing  requirements  of 
an  instructional  task  (an  overwhelming  responsibility  in  and  of  itself)),  it 
is  critical  that  we  extend  the  learning  tasks  that  we  examine  beyond  the 
verbal  information  objectives  that  are  common  in  the  research  literature. 
Particularly  if  the, instructional  medium  is  print,  we  may  profit  from  an 
examination  of  the  implications  of  the  limitations  of  cognitive  capacity. 
For  example,  when  a  learning  task  requires  the  processing  of  instructional 
text  in  order  to  learn  the  application  of  an  unfamiliar  scientific  principle, 
might  it  not  be  advantageous  to  supplant  some  of  the  text  processing 
requirements  in  order  to  allow  learners  more  mental  "working  space"  for 
dealing  with  the  complex  principle?  Other  task  features  which  require 
study  are  the  ambiguity,  complexity,  and  novelty  of  the  learning  task. 

The  constraints  of  the  instructional  environment  must  also  be 
considered  when  determining  the  balance  between  the  generative  and 
supplantation  mddels.  For  instance,  when  the  designer  anticipates  that 
learners  will  be  under  debilitating  time  contraints,  a  tendency  toward  the 
supplantation  model  may  be  entirely  appropriate. 

While  investigating  the  interplay  of  the  learner,  task,  and  learning 
environment  a  determinents  of  the  most  appropriate  balance  between  the 
two  extremes  in  the  design  models,  it  is  important  that  researchers 
utilize  a  number  of  dependent  variables.  We  may  profit  from  extending 
dependent  variables  to  include  measures  of  an  efficiency/effectiveness 
ratio,  levels  of  attention,  fatigue  or  boredom  reports,  and  long-term 
effects  of  both  supplantation  and  generative  models. 

Conclusion 

As  the^  field  of  instructional  technology  matures,  we  seem  to  be  moving 
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beyond  the  unquestionably  effective  techniques  of  the  neo-behaviorists: 
the  manipulation  of  the  instructional  stimulus  to  produce  the  desired, 
observable  learning  outcome.  Many  of  us  are  investigating  ways  to  refine 
this  approach  in  order  to  accommodate  potent  factors  that  we  have  not 
considered  in  the  past.  One  of  these  factors  is  the  learner.  In  addition  to 
the  general  aptitudes  and  prior  knowledge  of  the  learner,  we  wish  to 
examine  the  design  Implications  of  the  idiosyncratic  processing 
strategies,  cognitive  organizations,  and  intentions  of  the  learner.  Being  in 
the  business  of  producing  effective  and  efficient  instruction  we  are  also 
concerned  with  the  pragmatic  question  of  the  extent  to  which  we  can 
afford  to  accommodate  (even  recognize)  these  idiosyncracies.  In  this 
presentation  i  have  suggested  one  scheme  within  which  we  may  begin  to 
investigate  these  issues:  a  search  for  the  conditions  which  specify  the 
optimal  balance  between  the  supplantation  and  generative  models  of 
instructional  design. 
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Dictionary  definitions  of  literacy  generally  incorporate  the  two 
dimensions  of  being  able  to  read  and  write  (i.e.  communicate) ,  and 
being  knowledgeable  or  well-informed.   These  definitions,  especially 
when  applied  to  the  notion  of  universal  literacy,  have  been  commonly 
translated  as  the  minimal  amount  of  knowledge,  and  skills  necessary 
for  an  individual  to  function  effectively  in  modern  society. 

This  dual  conception  of  literacy  as* -functional  knowledge  and 
(communication)  skills  has  provided  the  parameters  of  the  debate  on 
computer  literacy.*  1n  some  cases  definitions  have  stressed  only  dne 
dimension.   Computer  literacy  has  been  defined  as  either  having 
(programming)   skills,  that  is  "the  ability  to  do  computing" 
(Luehrmann,   I98l),  or  possessing  knowledge  of  computers  and/or  their 
social  impact   (sometimes  referred  to  as  "computer  awareness91).  Other 
writers  have  criticized  this  dichotomy$and  suggested  that  both  are 
necessary:    "there  are  two  (not  just  one)   generally  accepted 
definitions  of  literacy",  namely  "the  ability  to  communicate"  and 
"the  state  of  being  informed"    (Anderson  et  alv«'19Sl).  These  authors 
examined  the  literature  on  computer*  literacy  and  noted  a  continuum 
ranging  from  an  emphasis  on  knowledge  of  programming  to  an  awareness 
of  applications  and  issues  concerning  the  impact  of  computers  on 
society.  Subsequently  they  offered  their  "comprehensive  view"  in 
which: 

"computer  literacy  should  be  thought  of  as    the  knowledge  and 
skills  the  average  citizen  needs  to  know  (or  do)   about  computers11. 
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Bar g er  <  1983.)  attempted  to  unite  all'  perspectives  by  advocating 

knowledge  of  both  how  computers  work   ( "structure  and  operation")  and 

*  %  .  • 

their  impact  on  the -individual  and  society  ("applications  and 

V 

limitations"),  as  well  as' a  minimal  level  of  programming  skills.  His 
summary  of  computer  literacy  definitions  illustrates  that  the  debate 
has  been  focussed  on  what  type  of  knowledge  is  necessary  and  what 
level,  if  any,  o-F  programming  should  be  taught^ 

Ail  these  arguments  and  definition?,  however,  'reflect  a 
particular  view  of  epistemol ogy f  pedagogy,  the  nature  of 
communication,  and  the  role  of  schooling  in  relation  to  the  t^pciai 
order.  Discussion  about  these  underlying  assumption^  has  been 
conspiciousl y  absent  from  the  literature  on  computer  literacy-  This 
paper  is  an  attempt  to  rectify  this  situation  by  provoking  such  a 
discourse  and  .offering  an  alternative  view  of  these  assumptions.  The 
alternative  perspective  implies  a  markedly  different  conception  of 
computer  1 i  teracy- 


The  Dominant  or  Functional  Paradigm 

Defining  computer  literacy  on  the  basis  of 'developing  a 
comprehensive  list  of  performance-based  objectives,  as  undertaken  in 
a  project  of  the  Minnesota  Educational  Computing  Consortium  (Johnson 
et  al ,   1980),  legitimatizes  one  kind  of  knowledge  and  skills:  that 
which  is  discrete,  factual  and  measurable  "by  explicit  and  public 
criteria"    (Popkewitz  et  al ,   19S2) .  Burrel 1  and  Morgan  (1979)  hfeve 
described  two  opposing  views  of  knowledge.  The  first  view,  which  is 
exemplified  above,  characterizes  knowledge  as  objective,  rational 
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and  truthful. (i.e.   something  to  be  accepted).   This  form  of-'knowledge 

is  external  to  the  individual  and  "capable  o-f  being  transmitted  in  a 

tangible  form"  to  receptive  others*..  • 

This  epistemology  leads  to  a ^pedagogical  perspective  of  the  * 

student  as  a.  de-ficit  learner,  with  classroom  instruction  following  a 

:   •  ,  •  N  , 

symbolic  abstract  or  "information  assimilation"   (Coleman,  1976) 

learning'  process.  Such  a  process  emphasizes  efficiency  in  mastering 

4 

knowledge  of  the  past.   It  relies  heavily  on  students  possessing  the 
language  skills  for4  encoding  abstractions  and  the:  ability  to 
transfer  symbolic  learning  into  action   (Cunningham,  % 983) 1  Cof emah 
nominated  this  dependence  oh  language  as  the  critical  problem  with 
the  information  assimilation  method,  especially  for  "subordinate' 
groups  within  4he  cultbre  who  may  lack  elaborated  larfguage  codes11 
(Cunningham,   1983) .   Ytet  computer  literacy  codes  are  further  remove 
in  abstraction  from  concrete  experiences  and^acti pn  than  natural 
language.  So  the  development  of  knowledge  and  skills  for 
understanding  and  using,  computers  demands  a  facility  with  the 
abstract  symbolic  mode  of  thinking.         '  * 

Ambiguous  or  problematic  knowledge  and  incidental  learning 

b 

receive  no  attention  in  this  paradigm.  But- most  significantly,  as 
Freire  has  criticized,  the  possession  of  knowledge  is  separated  from 
the  act  o*  craatinq_Jknowledge  (Mackie,   1981)  .   Not  on^  is  the  „ 
generation  <?f  knowledge  ignored,  but  so  is  "the  learning  of  skills 
and  attitudes  appropriate  for  creating  knowledge"   (Popkewitz  et  al , 
1982).    '  ' 
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Objective  or  scientific  knowledge  and  information  assimilation 
(  learning  are  predicated  solely  upon  the  rhetorical  form  of 

communication.  The  essence  of  rhetorical  communication  is 

•  *  •* 

..transmission  of  the  writer's  (or  speaker's)  structure  of  reality  in 

'k 

a  form  that  can  be  translated  by  the  'reader  (or  listener)  into 
his/her  own  framework  of  reality.   In  other  words,  a  sender  "has  a  * 
message  to  convey  to  a  receiver.  Rhetoric  to  be  communicated  must  be 

brought  into  the  individual's  consciousness  and  externalized:  a 

*  •  • 

process  that  implies  A  conscious  control  of  one's  understanding  of 
reality.  Computer  literacy t&at  involves  communication  via 

programming  languages  requires  an  eve>i  more  precise  control  of  one's 

•  * 

though^^processes.  -  %  rN 

*  The  paradigms  of  knowledge,  learning  and  communication 

*  *  *  • 

discussed  to  this_point  share  a  functional  or  instrumental  purpose. 

-  *  ■' 

*A    Rationales  for  computer  literacy  are  highly  congruent  with  the 
functionality  orientation  of  these  'paradigm^   For  example, 
rationales  have  ex posited  the  need: 

-to- improve  the  nation's  economic  productivity  in  the  face  of 

.  v 

foreign  competition  and  "to  maintain  our  national  defense"  (Deringer 

9 

&  Molriar,   1982) j 

*•     *  •  *  •  # 

-for  individuals  to  function  "effectively  within  a  given  societal 

'  >  role",  such  as  scientists,  engineers,  managers,  students,  ,.etc. 

( Anderson  ,  ,1982) ;   and.  . 


tec 


-for 

n*noi  v 


nts  "to  function  as  contributing  members'  of  a  modern 
society"   (Barger,  1983). 
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Furthermore,  a  computer  literacy  curriculum  based  on 
individuals.'  societal  roles,  or  "the  context  in  which  they  handle 
information",  has  been  proposed   (Seidel,   1982).  The  intention  is 
that  "some  people  need  low  level  understanding  (of  computers)  and 
others,  e.g.  students  and  engineers,  need  higher  level 
understanding"  (Anderson,  1982). 

\ 

A  computer  literacy  curriculum  developed  for  such  instrumental 

*\  * 

ends  ha4  an  implicit  political  agenda,  namely  to  maintain  the 
existing  social  order  and  stratify  the  student  population  into 
.workfor   v    rategories.  Social  control  and  cultural  transmission, 
where  culture  is  defined  by  *:hose  having  power  in  society,  have  been 
described  as  a  critical  rolr.  of  schools   (Young,  1971;  Bowles  & 
Gintis,   1976;   Apple,   1979;   Popkewitz,   1983).  At  the  same  time  it 
should  be  recognized  that  schools  are  only  one  part  of  a  larger 
framework  of  social  structures  that  reproduce  unequal  (by 
class, gender ,  and  race)  social  relations   (Apple, 1982) .   In  the  past 
"industrial  states  have  found  it  prudent  to  shape  the  distribution 
of  literacy  to  their  own  ends",  and  supported  mass  literacy  after 
the  industrial  revolution  to  obtain  "workers- with  a  greater  range  of 
skills  for  operating  the  increasingly  specialized  machine  of 
industrial  society"   (Marvin  &  Winther,  1983).  Current  conceptions  of 
computer  literacy  maintain  this  traditional  function  of  schooling. 

Tht»  Alternative  or  Critical  Paradigm 

A  second  epistemology  views  knowledge  as  "more  subjective, 
spiritual  ...  and  essentially  personal "(in)  nature"   (Burrrell  &  * 
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Morgan,   1976).    It  recognises  the  learner  as  an  active  participant  in 
I 

the  production  of  meaning.   Thus  the  possession  and  creation  of 
knowledge  are  inexorably  linked.   The  multiple  construction  of  social 
realities  is  presumed  with  knowledge  being  socially  constructed  from 
interaction  in  interpretati ve^ communi ties  and  from  negotiation 
between  teacher  and  student   (Esland,   1971;  Belseyf   1980).   This  view 
of  knowledge  has  been  related  historically  to  literacy?  "every 
measure  of  literacy  ever  devised  appeals  to  some  criterion  of 
success  in  interpreting  messages,  and  success  in  interpreting  * 
messages  will  always  be  socially  constructed  rather  than  an 
objective  category"  ^(Marvin  8c  Winther,  1983). 

As  social   knowledge  involves  extracting  meaning  from 
experience,  the  pedagogical  starring  point  is  a  learning  process 
based  on  experience.   Coleman   (1976)   has  advocated  an  increased 
emphasis  on  experiential   learning  in  schools,  especially  "for 
students  who  have  limitations  in  the  information  assimilation 
method".  At  the  same  tipie  he  maintained  that  eventually  students 
must  develop  the  language  skills  to  participate  successfully  in  the 
traditional  system  (Cunningham,   1983).  This  perspective  on 
experiential  learning,  however,  retains  the  deficit  view  of  the 
learner  and  the  legitimation  of  only  knowledge  sanctioned  by  the 
dominant  culture.   In  both  respects  it  differs  from  approaches  that 
emphasize  social  and  cultural  context. 

Freire  has  stressed  that  "literacy  cannot  be  viewed  in 
isolation  from  its  social  context",  which  is  the  "glaring  omission 
in  most  functional  analyzes  of  1 i teracy"^Mackie,   1981).  He  added 
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that  literacy  "can  serve  either  to  liberate  human  beings  or 

* 

domesticate  them".   Interestingly,  Barger   (1983)   acknowledged  the 
relationship  of  computer  literacy  to  social  domination  and 
oppression:    .  v- 

"If  a  technical  elite  is  not  to  gain  tyranny  over  the  common 
person  ...  computer  literacy  will  be  essential  to  human  autonomy  in 
the  future" . 

He  naively  assumed,  however,  that  a  "non-technical  or 
low-technical  understanding  of  what  computers  are  and  how  they 
work",  an  understanding  of  computer  applications  and  limitations, 
and  a  minimal  level  of  programming  ability  "will  probably  be 
sufficient"  to  overcome  this  threat.   This  approach  ignores  the  power 
relationships  within  society  and  the  plight  of  students  who  do  not 
belong  to  the  dominant  culture.  And,  as  Marvin  and  Winther  (1983) 
have  pointed  out,   "the  extent  to  which  written  literacy  is  already 
economically  and  socially  stratified  will  strongly  influence  the 
distribution^  of  computer  literacy  as  well".  - 

The  alternative  or  critical  perspective  seeks  to  empower 
students  of  the  working  class  or  minority  groups  who  are 
disadvantaged  or  oppressed.   Instead  of  emphasizing  their  deficits  &s 
learners,  it  "assumes  that  problems  for  individual  learners  may  have 
their  source  in  the  structures  of  society1*   (Cunningham,   1983).  The 
approach  initially  concentrates  on  students'  concrete  experiences 
mi  thin  their  own  social  and  cultural  context.  An  analysis  of  these 
experiences  is  intended  to  lead  to  "a  heightened  social  awareness 

and  ability  to  examine  critical  issues"     of  ten  termed  "critical 

$ 
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consci ousness"    (Cunningham,   1983).   Two  key  features  emerge  from  this 
approach.   First,  cognitive  skills  such  as  analytical  and  critical 
thinking  evolve  when  developed  in  the  content  of  the  student's 
experiences  and  examing  how  power  functions  in  the  social  system. 
Second,  the  development  of  critical  consciousness  (concerning  social 
power)  demystifies  knowledge  and  school ing*  and  empowers  students 
with  control  over  their  own  learning.  Traditionally  schooling 
delineates  who  has  the  knowledge,  and  what  and  ho^  that  knowledge  is 
to  be  learned.   The  critical  perspective  transforms  this  situation  so 
that  the  student  holds  the  power  over  what  and  ho*  he/she  learns. 

Finally,  a  second  form  of  communication  has  an  important  role 
in  the  critical  paradigms.    In  contrast  to  rhetorical  communication, 
expressive  communication  involves  the  representation  of  a  person's 
feelings  or  ideas  in  a  form  that  has  meaning  to  the  same  person. 
Here  the  transmitter  is  the  intended  primary  recipient  of  the 
message.   Our  natural  language  is  a  vehicle  for  expressing  and 
clarifying  personal  .feelings  and  subjective  accounts  of  reality. 
Expressive  commmuni cation ,  using  natural  language  in  various  forms 
(including  prose,  drama,  and  poetry)  or  music  or  painting  or  other 
artistic  medium,  enables  us  to  be  interpretive,  critical,  and  even 
irrational.  Computer  languages  require  us  to  be  procedural  and 
scientifically  rational  -  and  admittedly  enable  us  to  be  creative 
but  within  syntactical  bounds.   In  other  words  the  computer 
epitomizes  only  bne  kindt  of  rationality,   "scientism"  op~4-o^ical 
empiricism,  and  excludes  kinesthetic,  ethical,  spiritual,  and  most 
aesthetic  forms  of  thought  and  expression. 
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Marine  Greene   (1982)  has  eloquently  connected  the  arts  and 
literacy  through  the  ability  of  works  of  art  to  continually  provoke 
a  search  for  meaning*  Works  of  art,  she  argued ,  are  generally 
inexhaustible  -  no  matter  how  familiar  they  become  -  in  eliciting 
interpretation,  critical  thinking,  and  reflection;   and  in  providing 
opportunities  to  perceive  and  integrate  multiple  perspectives  of 
reality.  Owing  to  these  characteristics  one  could  Add  that  they  can 
help  us  confront  ambiguity  as  well  as  remind  us  that  reality  is  " the 
product  of  individual,  consciousness"    (Burrell  &  Morgan,   1979> -  In 
turn  confrontation  with  ambiguity  and  "irrational H  perceptions  of 
reality  illustrate  the  significant  dimensions  of  our  world  that  we 
cannot  control.   Greene  did  not  stop  at  the  experiencing  of  art  and 
literature  but  added:   students  must  be  encouraged  "to  express  what 
they  see  and  hear".  Such  expression,  through  whatever  medium, 
liberates  the  individual  by  giving  "public  form  to  private 
awareness"  and  simultaneously  thwarts  both  loneliness  and 
power lessness.  > 

Greene's  view  of  epistemology  obviously  has  much  in  common  with 
that  of  Freire.  Although  a  concern  for  the  cultural  context  of  the 
learner  is  not  shared,  her  notion  o-f  literacy  also  emphasizes 
empowered  learning  and  thus  unites  the  critical  paradigms: 

"Teachers  who  conceive  their  students  as  some  plastic  material, 
or  some  sort  of  resistant  medium,  cannot  think  of  empowering 
students  to  learn  how  to  learn,  to  articulate,  tto  be  with  one 
another " • 
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The  Critical  View  of  Computer  Literacy 

Several  issues  emerge  in  constructing  a  conception  of  computer 
literacy  from  the  perspective  of  the  critical  paradigms  outlined. 
First,  as  the  work  of  Freire  and  Greene  has  indicated,  the  quest  for 
consciousness  and  social  knowledge  or  personal  meaning  involves 
critical  reflection  upon  and  analysis  of  experiences  and  actions. 
These  experiences  should  take  place  within  the  context  of  the 
student's  soci o-cul tural  reality  (Freire)  or  encounters  with  works 
of  art  or  literature  (Greene).  Additionally  for  both  authors,  the 
"act  of  knowing"  and  "conscientization"  comprises  dialogue  or 
expressive  communication.  Thus  the  first  question  must  be:  How  can 
contextually  meaningful  experiences  and  actions  with  a  computer  help 
the  student  createitand  express  personal  meaning  and  critical 
consciousness?  SeAnd,  the  development  and  expression  of  critical 
consciousness  is  attended  to  liberate  the  student  from  domination  or 
powerlessness  in  social  relationships  so  that  empowerment  over 
his/her  learning  resilts.  This  suggests  the  second  essential 
questions  How  can  the  student  be  empowered  to  learn  in  a  dialogical 
relationship  with  a  computer? 

While  it  has  been  claimed  that  the  computer  can  provide  "ai> 
structured  set  of  experiences11   (Bark,  1980)  ,  these  are  simulated 
abstractions  of  real  experiences  that  can  be  quantified  or  visually 
represented.   It  should  also  be  remembered  that  the  simulated 
experiences  in  instructional  software  tend  not  to  relate  to  the 
everyday  experiences  of  students  of  subordinate  social  or  cultural 
groups.  Similarly  the  manipulation  of  abstractions  involved  in 
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programming  requires  a  high  level  of  language  literacy  that  is  often 
beyond  such  groups.   M  these  two  problems  are  overcome,  then 
computer-based  heuristic  strategies,  and  heuristic  languages  such  as 
LOGO,  may  help  a  student  develop  a  schema  for  organizing  meaningful. 

r 

knowledge  and  foster  a  divergent  mode  of  critical  thinking   (in  a 
performance  sense).  Computer  heuristics,  however ,  cannot  create 
personal  meaning  or  develop  critical  consciousness. 

Perhaps  then  the  second  question  provides  some  justification  or 
hope  for  computer  literacy.  To  Freire  the  essence  of  empowered 
learning  is  problem  posing  in  which  "students  are  required  to 
examine,  to  know,  and  to  transform  their  world,  and  thus  participate 
in  genuine  communication11    (Mackie,   1981).  Posing  problems,   in  these 
terms,  is  a  semantically  demanding  activity.  Protl ems  posed  for 
examination  by  computer  necessitates  their  expression  in  a 
syntactical,  symbolic  and  quantifiable  form  with  the  inherent  danger 
that  human  problems  become?  reified  and  divorced  from  their  social 
and  cultural^  context.  * 

The  only  apparent  solution  compatible  with  the  critical 
paradigms  is  to  'treat  the  computer  as  i  cultural  object  for  critical 
re-flection.   In  this  case  the  computer,  including  its  social  power, 
is  posed  as  a  problem,  in  an  historical  and  cultural  context, 
requiring  cooperative  investigation  bystudents  and  teacher.  Watt's 
(1982)  idea  of  treating  the  school  as  a  microcosm  of  society  in 
which  students  investigate  "changes  occurring  in  the  social 
organization  of  the  school "  from  the  introduction  of  computers  could 
be  employed  as  one  part  of  this  approach'. 
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Only  a  dialogical  relationship  between  student  and  teacher  can 
provide  the  semantic  engagement  and  negogiation  essential  for  the 
problematizing  of  one's  existential  Situation  and  the  construction 
of  critical  consciousness.  The  computer,  as  an  increasingly 
significant  part  of  many  students'  life  experiences,  does  have  a 
place  in  the  curriculum  as  an  object  of  inquiry  in  the  continual 
construction  of  social  knowledge.  All  other  conceptions  of  computer 
literacy  beyond  this  one  risk  assigning  consciousness  and  autonomy 
to  computers,  in  which  case  we  surrender  our  uniqueness  vas  human 
beings  and  our  quest  for  the  meaning  of  our  existence  <weizenbaum, 
1976) . 
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ABSTRACT 


The  research  was  designed  to  determine  young  children's  learning 

_from  selected^  television .program  content  where  the  subject  matter   

varies  and  to  test  for  a  relationship  between  that  learning _and  the   

-  amount  of  time" a  child  watches  television  w'itli  arid  without  adults. 
It  used  a  unique  learning  test  developed'  from  selected  television 

segments  using  instructional  design  principles.    A  score  was   ; ... 

determined  for  each  subject  on  each  broadcast  segment,  as  well  as  a 
total  score.    These  were  the  dependent  variables.    The  independent 
variables  included:  age,  sex,  level  in  school,  television  viewing 
hours  with  and  without  an  adult,    birth  order,  family  composition,  and 
education  of  parents.    This  study  assumes  that  television  learning 

.tests  can  be  developed;  assessment  can  be  made  of  what  children 
learn  from  television;  variables  can  be  identified  that  account 
for  the  variance  in  scores /on  the  television  learning  tests.  Data 
for  this  study  of  261  K-2  children  were  gathered  using  developed 
tests  of  learning  for.  four  broadcast  television  segments:  a 
:30  Betty  Crocker  commercial,  a  4s 00  Batman  segment,  a  2:00 
MIG-25  news  story,  and  a  2:55  segment  of  Electric  Company.  I-n 
addition,  a  questionnaire vwas  sent  to  parents/guardians  of  all 
subjects.    Using  Statistical  Analysis  System,-  the  data  were 
analyzed  using  frequencies,  bivariate  correlations,  and  multiple 
regression  analysis.    The  bedt  stepwise  regression  model 
'using  the  learning  score  as  the  dependent  variable  is  a  four 

-variable  model.     It  accounts  for  35%  of  the  variance  in  learning 
test  scores.    Variables  in  the  model1 include  level/age  which  accounts 
for  27%  of  the  variance  in  children's  learning  scores,  achievement 
in  school  as  ranked  by  teachers  (3%) ,  the  average  educational'  level 
of  adults  in  a  subjects'  home  (3%),  and  amount  of  viewing  with 
adults  (3.5%).    An  item  analysis  was.  run  on  all  28  items  of  the  test 
by  both  grade  and  by  grades  combined.    This  study  concludes     ,  v  - 
that  the  amount  of  viewing  that  a  child, does  with  adults  appears 
to  make  a  difference  in  how  well  s/he  understands -what  is  viewed; 
that  subjects  in"  this  study  whose  adults  rin  the  home  had  more 
education  were  reported  to  watch  less  television  than  others,  usually 
had  fewer  siblings,  did  better  in  school,  and  learned  more  from  the 
selected  television  programming,  especially  programing  designed 
to  teach  content  traditionally  taught  in  elementary  schools;  that 
the.  amount  of  viewing,  sex,  birth  order  and  family  size  do  not 
appear  to  have  any  relationship  to  how  much  cbgnitively  a  child  learns 
from  television.  ,   MJ  ......  ADtr 
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*   '  /     Problem  and  Rationale  , 

It  has  been  suggested  as  a  model* of  communication  that 
at  any  point  in  time  each  person  lives  within  a  communication 
#    .  mosaic  (See  Becker  dited  in  Mortehsen,  1972) .    The  mosaic 

•  *  * 

*  communication  model,  unique  for  each "individual,  is 

composed  of  all  the  bits  and  pieces  of  information  from 
various  sources, —  for  example,  television  —  to  which  an 
individual  is  exposed.    The  communication  mosaic  is 
dynamic,  changing  with  the  individual's  development, 
exposure  patterns,  attention  levels,  and^ world  view. 
Two  individuals  seemingly  exposed  to  the  same  bits  of 
information  are  in  fact  probably  perceiving  very  different 
realities,  because  of  other  variables,  such  as  cognitive 
style,  competing  sources  of  information,  and  context 
of  the  message.    What  may  be  an  impressive  bit  of  information 

■  * 

for  one  individual  may  Jbe  -of ^  little  consequence  to  another,  '• 
depending  upon  the  operating  communication  mosaic  of  each. 

Television  as  a  source  of  information  need  not  be 
argued,  in  the  United  States.     The  pervasiveness  of  this 
medium  is  supported  by  census  data  reporting  the  in-» 
creasingly  higher  number  of  hours  per.  day  and  week  that 
increasingly  more  television  sets  are  on,.     It  is  the 
rare  individual  for  whom  television  does  not  play  some  ' 
part  as  an  information  source  within  h^s/her  communication 
mosaic.     Television  is  an  information  source  and  a  learning 
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source  for  all  individuals.  v. 

Even  outside  the  theoretical  framework  of  the  mosaic 
mMel  of  communication,  researchers  early  established  that 
children  can  learn  from  television  (Lesser,  1972;  Salomon 
et  al.,  1972;  Meichenbaum  &  Turk,  1973;  Raphael  &  Wagner, 
1974;  Henderson,  Swanson,  &  Zimmerman,  1975;  Children's 
Television  Workshop,  1977).    It  can  be  said  that  learning 
occurs  every  single  time  a  person  views  television. 
It  does  not  have  to  be  an  "educational"  television  pro- 
gram to  produce  learning.    All  television  is  educational. 
The.  important  question  is  not  what  sort  of  television  is 
educational,  but  rather  what  is  learned  from  any  particular 
broadcast  (Storm,  1976) .    This  is  consistent  with  the  mosaic 
model  of  communication  which  would  extend  the  question  to 

what  is  ^earned  by  each  individual  given  his/her  back- 

*  ■  * 

ground,  age,  and  numerous  other  variables  unique  for  each 

person.      m  • 

Neither  the  importance  of  the  developing  individual, 

n6r  the  importance  of  the  overall  context  of  exposure 

can  be  overlooked  when  researching  learning  from  any. 

medium.    To  study  television  in  the  context  of  the 

individual's  communication  mosaic  at  least  two  types 

.of  research  are  important:     1)     content  analyses  of 

medium,  and  2)     studies  of  learning  from  television  that 

include  descriptive  information  on  individual  children 

viewing  television. 
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This  study  was  designed  to  explore  young  children's 
learning  from  selected,  television  programs  with  attention 
to  the  viewing  context  and  the  child's  family  composition. 
No  attempt  was  made  to  determine  the  beneficial  or 
deleterious  effects  of  television  programs,  but  rather 
to  measure  learning  where  the  subject  matter  varied, 
and  to  determine  the  relationship  of  other  variables  to 
that  learning. 

No  hypotheses  were  formed  for  this  study,  but  rather, 

questions  about  children's  learning  from  television  were  

asked.    They  included: 

1)  What  relationship  exists  between  the  amount 
of  time  a  child  watches  television  with  ancl  without 
adults  and  that  child *s  learning  from  television? 

2)  What  relationship  exists  between  school  achievement, 
education  of  parents  and  learning  from  television? 

3)  v-ihat  is  the  relationship  between  sex,  family  size, 
birth  order,  and  learning  from  television? 

* 

Related  Literature 

It  became  apparent  in  the  '70s  that  children  definitely 
learn  from  television  (Bandura,  1965;  Gage,  1963?  Salomon 
et  al.,  1972;  Lesser,  1972;  Meichenbaum  &  Turk,  1973; 
Henderson,  Swanson,  &  Zimmerman,  1975);  the  concern  turned 
to  "what"  they  learn  and  how  to  approach  measurement  and 
"evaluation  of  learning  from  television. 

According  to  the  theories  of  instructional  technologists 
and  social  learning  scholars,  the  question  of  what  is 
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learned  from  television  can  be  approached  by  studying 
what  is  programmed  for  television.    These  theories  have 
stimulated  numerous  content  analyses,  with  sexism,  racism, 
and  violent  behaviors  most  studied.    Beale  (1975)  suggests 
the  examination  of  intention  through  content  analysis,  but 
Adams  &  Schreibman  (1978)  argue  that  content  analysis 
cannot  replace  audience  research  for  answering  questions 
about  learning.     Snow  (1974)  criticizes  research  on  children 
learning  from  television  that  fails  to  define  situations 
in  other  than  adult  terms. 

While  learning  occurs  each  time  there  is  an  exposure 
to  television  content,  children  may  fail  to  learn  what 
a  particular  producer  intends  due  to  poorly  designed 
instruction/content.     Friedlander   (1975) ,  for  example, 
suggested  that  a  student's  failure  to  learn  the  producer 
intended  cognitive  content  in  certain  public  health  films 
can  be  attributed  to  confusion  between  a  film's  audio 
and  video  messages.     It  should  not  be  mistaken  that  no 
learning  occurs.     The  learning  that  occurs  is  dependent 

« 

upon  the  learning  designed,  intended  or  not  — 
labelled  "educational"  or  not.    The  learning  designed 
can  be  found  by  an  analysis  of  the  instruction/content 
using  any  one  of  several  instructional  design  models  (Storm, 
1980).  • The  concern,  then,  should  be  the  content  analysis 
from  the  perspective  of  the  viewer  of  the  content,  rather 
than  just  the  content  itself. 
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With  the  exception  of  the  Children's  Television  Workshop, 
most  broadcasters  rarely  attempt  to  control  cognitive  or 
affective  learning  outcomes.    Objectives  of  programs  are 
often  unrelated  in  an  instructional  design  sense.  This 
does  not  mean  that  cognitive  and/or  affective  outcomes  are 
not  being  produced.    Early  research  on  cognitive  learning 
found  that  only  younger,  duller  children  actually  gained 
knowledge  from  television  (Himmelweit,  Oppenheim,  &  Vince, 
1958).     Yet,  the  question  must  be  asked  about  what 
1950s  television  information/content  had  designed  for 
cognitive  learning.     Also,  what  specific  1950s  television 
content  was  used  in  the  early  studies.    While  certain  genres 
exist,  not  all  television  is  alike,  anymore  than  all  books 
are  alike.     Television  is  a  medium  only  —  a  channel  for 
information/content;  a  medium  constantly  changing  its 
content. 

1  •  •  . 

With  the  changing  information/content  of  the  medium 

and  |n  the  context  of  the  mosaic  model  of  communication, 

television's  exposure  environment  becomes  important  in  the 

measurement  and  evaluation  of  learning.    An  estimate  of 

^his  context  of  exposure  can  be  obtained  from  knowing 

the  viewing  patterns  of  the  consumer:     what  programs 

an  individual  usually  watches,  who  else  watches  the 

programs  with  that  individual,  what~goes  on  during 

viewing,  what  after,  etc.    Leifer,  Gordon  and  Graves  (1974) 

suggest  that  the  presence  of  a  respected  adult  during 

program  viewing  can  greatly  influence  a  child's  reaction 
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to  the  content.    This  adult  can  be  1)  controller  and 
cultivator  of  program  preference,  2)  commentator  during 
viewing  and  later  acting-out  behavior,  and  3)  discerner 
of  reality.     If  what  these  researchers  conjecture  is 
true,  adult  viewers  have  the  potential  to  determine  the 
social  effects  of  programming  (see  also  Adler,  1978)  as  well 

w 

as  the  cognitive  outcomes  of  exposure.     Heald  (1980) 
recognized  the  potential  influence  parents  have  on  children's 
viewing  patterns  by  presenting  parents  with  guidelines 
and  recommendations  for  viewing  with  children. 

While  the  potential  effects'  of  a  respected  adult 
viewing  television  with  children  is  recognized,  most 
researchers  (McLeod,  Atkin.  &  Chaffee,  1972;  Greenberg, 
Ericson  &  Vlahos,  1972;  Thompson  &  Slater,  1983)  found 
that  the  majority  of  parents  do  little  more  than  place 
minor  limits  on  their  children's  television  viewing, 
if  that.     Abelman  (1984)  warns,  however,  that  the  parent- 
child  interaction  should  not  be  ignored  for  the  predis- 
positions it  might  imply.     Information  might  be  collected 
. from  adults  as  to  how  much  viewing  is  done  with  children, 
what  form  it  takes  and  what  levels  of  educational  background 
the  adults  bring  to  the  environment.     Landes  (1975), 
commenting  on  the  linguistic  environment,  says  that  it  is 
often  taken  for  granted  in  research  on  speech  acquisition. 
He  states  that  ignoring  the  input  of  parents  and  environmental 
factors  for  innate  ideas  is  unfortunate.    He  suggests  that 
researchers  specify  the  environment. 

* 
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Research  Methodology 


Two  hundred  -sixty-one  kindergarten,  first  and  second 
grade  students  were  the  subjects  of  this  study.    After  pilot 
testing,  219  subjects  were  available  tc  be  tested  for- 
cognitive  learning  after  viewing  randomly  selected  broad- 
cast television  segments.     Program  content  for  this  study 
was  selected  at  random  from  a  single  weekday  of  network 
broadcasting.    The  first  segment  selected  was  a  0:30  commercial 
The  second  selection  was  a  4:00  portion  of  Batman .    A  2:00 
news  story  on  the  Russian  MIG-25  fighter  plane  seen  on 
ABC  was  selected  as  the  third  type.     The  final  selection 
was  a  2:55  segment  of  the  Electric  Company. 

An  instructional  development  approach  was  used  to 
construct  a  testing  instrument  for  each  broadcast  television 
segment.     The  process  included  two  major  steps:     1}  Identi- 
fication of  some  potential  learning  outcomes  for  each  -  segment , 
and  2)     Development  of  test  items  based  upon  the  potential 
learning  outcomes.     The  final  instrument  contained 
twenty-eight  items:     one  three-choice,  twenty-three 
two  choice,  and  four  free-response  items. 

J\  questionnaire  was  also  developed"  to  gather  clata 
from  a  parent  or  guardian  of  each  subject  on  :  amount 


of  viewing,  composition  of  family,  and  long  terra  context 
of  exposure  to  television  for  each  subject.  Respondents 
were  asked  to  assess  the  average  amount  of  time  their 
child  watched  television  during  the  school  week,  Saturdays 
and  Sundays.    They  were  also  to  estimate  the  amount  of 
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time  the  child  watched  television  with  an  adult  during 
the  school  week,  Saturdays  and  Sundays.    One  section  of 
the  questionnaire  included  questions  on  the  composition 
of  the  family  and  the  long  term  context  of  exposure  for 
each  subject. 

Classroom  teachers  were  asked  to  rank  students  in  their 
classes  according  to  academic;  achievement.  Three  categories 
were  used  in  the  ranking:    high,  medium  and  low. 

Small  groups  of  five  or  fewer  subjects  viewed  each 
televised  segment,  with  individual  interview  testing 
after  each  segment.    A  learning  score  was  determined  for 
each  subject  on  each  of  the  four  segments,  as  well  as 
a  total  learning  score.     These  were  the  dependent 
variables.     The  independent  variables  included:  age, 
sex,  level  in  school,  television  viewing  hours  with  and 
without  an  adult,  birth  order,  family  composition,  and 
education  of  parents. 

Using  the  Statistical  Analysis  System,  the  data 
were  analyzed  using  frequencies,  bivariate  correlations, 
and  stepwise  multiple  regression  analysis.     An  item 
analysis  was  run  on  all  28  items  of  the  test  both  by 
grade  and  by  grades  combined. 

Results 

The  number  of  subjects  included  in  each  of  the  following 
analyses  varies  according  to  the  values  available  for 
the  various  var  ibles. 
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Achievement 

Teachers  classified  79  (or  36%)  of  the  subjects  as 
high  achievers,  90  (41%)  as  medium  achievers,  and  47  (21%) 
as  low  achievers. 

Learning  Test 
The  learning  test  contained  28  questions  in  four 
segments,  one  for  each  of  the  televised  slices.    The  mean 
score  for  segment  one  was  2.74;  6.38  for  segment  two; 
/  3.75  for  segment  three;  and,  6.49  for  segment  four. 

The  learning  test  as  a  whole  had  a  mean  score  of  19.26  (69%). 
A  table  of  the  learning  test  raw  score  means  by  grades 
and  classrooms  for  each  segment  and  the  total  test  appears 
as  Table  1. 

Item  Analysis  of  Learning 
Measurement  Instrument 

0 

Itfem  analyses  were  run  by  grade  in  school  on  all 

t 

test  questions  used  to  measure  learning  from  broadcast 
segments.    The  items  for  all  grades  generally  discriminated 
positively  and  the  distractors  generally  discriminated 
negatively.    The  mean  test  discriminations  for  all 
grades  on  all  tests  was  equal  to  or  above  .22.  The 
range  in  mean  test  discriminations  was  from  .22  to  .58. 
The  mean  test  difficulty  for  all  grades  on  all  tests 
was  equal  to  or  above  49.    The  range  in  mean  test  difficulty 
was  from  49.20  to  85.78. 

Amount  of  Viewing 

* 

The  children  in  the  study  watched  a  great  deal  of 
I  RJC  .  .       799       3-  ■ 
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Table  1  • 

Raw  Score  Means  for  Learning 
Test  Segments* 


1 

Segments 
2  3 

4 

Total 

Perfect  Score: 

5. 

0 

9.0 

5.0 

9.0 

28.0 

„ « 

(24) 

room 

one  (am) 

2. 

**  • 

46 

5.79 

3.96 

5.54 

16.92 

V 
A 

(18) 

room 

two  (am) 

2 

50 

5.77 

3.66 

5.11 

15.67 

I03  J 

(231 

room 

one  (pm) 

2. 

60 

5.87 

3.83 

5.65 

17.52 

(20) 

room 

two  (pm) 

2 

80 

5.1 

3.95 

5.05 

15.85 

Total 

2. 

59 

5.63 

3.85 

5.34 

16.49 

(22) 

room 

one 

2. 

68 

6.55 

3.95 

7.18 

19.86 

1 

(68) 

(24) 
(22) 

room 
room 

two 
three 

2. 
2. 

67 
50 

5.84 
7.14 

3.92 
3.27 

7.17 
7.05 

20.58 
19.96 

Total 

2. 

62 

6.51 

3.71 

7.13 

20.13 

2 

(17) 

room 

one 

3. 

35 

7.53 

3.76 

7.70 

22.35 

(19) 

room 

two 

3. 

32 

7.37 

4.0 

7.63 

22.26 

(57) 

(21) 

room 

three 

3. 

,19 

7.19 

3.76 

7.90 

22.05 

Total 

3. 

29 

7.36 

3.84 

7.74 

(210) 

s 

2. 

,74 

6.38 

3.75 

6.49 

19.26 

*(1)  commercial,  (2)  Batman,  (3)  news,  and  (4)  Electric 
Company .    All  totals  broken  down  by  rooms  and  grade 
levels,  kindergarten,  first,  and  second. 
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television  both  with  and  without  their  parents.  Table  2 
displays  the  reported  viewing  hours  of  these  subjects  by 
week,  day,  average  Saturdays  and  Sundays.  The  mean 
reported  number  of 'hours  of  television  watched  alone  per 
day  during  the  week  is  3.40;  on  Saturdays,  4.5$  on  Sun- 
days, 3.04.  During  the  week  it  was  reported  that  subjects 
watch  an  average  of  2.47  hours  with  an  adult;  2.61  hours 
with  an  adult  on  Saturdays;  and  2.78  hours  with  an  adult 
on  Sundays . 

Family  Composition 
Children  in  the  study  came  largely  from  two-adult 

0 

households.    The  mean  number  of  adults  per  home  was  2  with 
173  of  the  subjects  reporting  two  adults  in  the  family 
home,  15  subjects  with  only  one  adult,  and  12  with  three 
adults.    Eighty-four  of  the  subjects  were  first-born  with 
52  second  children,  30  third  children,  18  fourth  children, 
6  fifth  children,  4  sixth  children,  2  seventh  children, 
1  ninth,  3  tenth,  and  1  eleventh  child.    Subjects  reported 
68  with  no  brothers  and  69  with  no  sisters.  Eighty-eight 
-had  one  brother  and  30  had  two.    Eighty-seven  had  one 
sister,  25  had  two,  and  16  had  three. 

Parents  of  the  children  tended  to  be  largely  high 

-  * 

school  graduates.    The  highest  reported  educational  degree 
was  a  master's  degree  (see  Table  3). 

Test  Day,  Test  Group, 
Test  Order 

There  was  no  significant  relationship  between  test  day, 
test  group  and  test  ordez  and  the  scores  on  the  learning 
tests. 
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Table  2 

> 


Absolute  Frequencies  and  Mean  Reported 
Viewing  Hours  Per  Child  Weekly* 


Hours  Daily 

During  the  Week    Saturday  Hours    Sunday  Hours 


No.  of 
Hours 

(alone) 

(with 
adult) 

(alone) 

(with 
adult) 

(alone) 

(with 
adult) 

0 

0 

8 

2 

22  ' 

5 

10 

1 

3 

38 

3 

33 

26  . 

31 

2 

44 

73 

12 

52 

52 

58 

3 

67 

36 

38 

31  * 

52 

43 

4 

52 

26 

43 

31 

32 

'  31 

5 

16 

9 

38 

14 

15 

13 

6 

11 

5 

36 

10 

11 

6 

7 

3 

1 

10 

1 

3 

3 

8 

0 

1 

13 

3 

4 

4 

Missing 

23 

22 

24 

_22 

19 

20 

Total 

219 

219 

219 

9  4 

219 

219 

219 

Mean 

3.40 

2.47 

4.58 

2.61 

3.04 

2.78 

*Total  mean  hours  of  television  viewing  per  week  is 
equal  to  42.36  hours. 
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•   Table  2 

Absolute  Frequencies  for  Highest  Degree  Obtained 
by  Adults*  in  a  Subject's  Family 


— T  !  

Adult 

Adult 

Adult 

Highest  uegree  UDiameo 

Ww  a  X 

Nn  2 

No  S 

m 

None 

6 

21 

'  24 

28 

Grammar  School 

1 

High  School 

138 

*124 

11 

Community  College 

20 

20 

1 

College- -BA 

6 

6 

College- -BS 

5 

2 

Master's 

2 

• 

Missing  Cases 

14 

14 

202 

Total 

21S 

215 

) 

215 

/ 

•Adults  defined  as  persons 

over  18  years  pf  age  living  in 

the  home. 

• 

\ 

t 

• 

r 

t 
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Bivariate  Correlations 

Level  in  School 
There  was  a  highly  significant  relationship  between 
learning  in  this  study  and  -the  level,  or  grade,  in  school 
with  i  »  .54,  p<.05.    Table  1  displays  the  raw  score 
means  for  learning  by  grade  level .    There  is  an  almost 
six  point  spread  between  kindergarteners  and  second  graders. 
The  largest  differences  were. in  test  scores  for  segments 
two  —  Batman  —  and  four       Electric  Company.    Grade  level  does 
not  appear  to  be  related  to  any  of  the  remaining  variables 

in  the  study  except,  of  course,  age. 

4.  *  m  • 

Age 

A  significant  relationship  between  learning  in  this 
study  and  a  subject's  age  was  found  with  r  »  .49,  p<^5. 
Neither  age  nor  grade  level  was  significantly  related  »to 
learning  from  the  news  segment.     "Age"  is  related  to  none 
of  the  other  variables  in  the  study  excep'V,  as  indicated 
above,  level  in  school.  K  * 

Achievement  in  School 
Achievement  in  school,  as  assessed  by  the  classroom  ' 
teachers,  was  found  to  be  related  to  the  total  learning 
score  with- r  =  .17,  p<.05.    Achievement*  in  school  was 
not  related  to  an  individual's  score  on  any  qf  the  first  . 
three  segments  of  the  learning  test:    'the  commercial, 

* 

Batman  or  the  news.  An  individual's  score  was  related  on 
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the  fourth  segment,  Electric  Company,  r  ■  .17,  p  <  .  05 ,  to 
school  achievement.    Achievement  was  found  to  be  negatively 
related  to  the  total  hours  a  subject  watched  television 
(r  =  -.25,  p  ^  .05),  the  amount  of  time  a  subject  watched 
television  with  an  adult  (r  =  -.2-1,  p<f  .05),  the  number 
of  hours  a  child  watched  television  alone  on  Saturdays 
(r  =  -.26,  p  ^.05),  the  number*  of  hours  a  child  watched 
television  on  Saturdays  with  an  adult  (f  -  -.23,  .05), 
the  number  of  hours  a  subject  reported  watching  television, 

# 

alone  on  Sundays  (r  »  -.24,  p<.05),  and  the  number  of 
hours  a  subject  reported  watching  television  on  Sundays 
with  an  adult  (r  =  -.19,  p<.05).    Children  ranked  by 

t 

teachers  as.  high  achievers  tended  to  report  watching  less 
television  either  with  or  without  adults. 

m 

Educational  Level  of  Adults 

in  Subject's  Home  ^ 

- 

The  relationship  between  the  learning  score  from  the 
television  material  in  this  study  and  the  average  educa-- 
tional  level  of  the  adults  in  the  subject's  home  was  sig- 
nificant at' the  .05  level  with  r  ■  .14. 

The  adults'  average  educational  level  and  the  total 
number  of  hours  a  subject  watched  television  weekly  were 
nfegatively  related  with  r  -  -.20,  p^r.OS.  "The  adults' 

< 

educational  level  was  negatively  related  to  family  size 
(r  =  -.17,  p£.05),  age  of  subject  (r  =  -.11,  p<£  .05) 
Saturday  television  hours  a  subject  watched  alone  (r  -  -.15 
p.  .05),  Saturday  hours  a  subject  watched  with  an  adult 

* 
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(r  -  -.25,  p^.05),  the  number  of  Sunday  hours  a  subject 
watched  alone  (r  -  -.20,  p<1.05),  and  the  number  of  Sunday 
hours  a  subject  watched  with  an  adult  (r  -  -.23).  a 
significant  positive  relationship  w,as  found  between  the 
adult's  average  educational  level  and  the  subject's 
achievement  in  school  with  r  -  -0.16,  p<r.05.* 

Significant  correlations  were  not  fouiia  to  exist 
between  the  learning  score  and  the  amount  of  viewing, 
birth  order,-  family  composition  (as  defined  only  by  the. 
number  of  adults  and"  siblings) ,  or  sex. 

All  of  the  segment  scores  are  reasonably  well  cor- 
related  .30  to  .57  except  fbr  the  learning  scores  for 
news  which  are  not  significantly  correlated  with  the 
learning  -scores  for  any  of  the  other  segments  (see  Table 
4). 

Stepwise  Multiple  Regression  Analysis 
Regressions  were  run  in  L  stepwise  fashion  using  the 
statistical  analysis  system.     The  computer  Selected  the 
order  for  entry  of  significant  variables  i^to  the  model. 

/  * 

The  best  stepwise  regression  model  ufeing  the  learning 
score  as  the  dependent  variable  is  a  four  variable  model . 
It  appears  as  Table  5.     This  model  accounts  for  35%  of 


*A  negative  r  here  is  the  result  of  the  way  in -which  data 
were  gathered  and  coded:    higher  numbers  meant  more  educa- 
tion for  the  variable  adults'  average  educational  level; 
lower  numbers  meant  higher  achievement  in  school  for  that 

variable. 
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4     ^  /table  4* 

V 

Summary  of  Correlations  between  Age,  Level 
-^~in  School,  Achievement  in  School,  • 
Education  of  Adults,  and  the 

Four  Segments  and  Total       *  " 
Learning  -Scores 

■     J—    •  *L    '  .    '  '  ■ 

~~  "  Electric 


Commercial 

Batman 

News 

Company 

Total 

— 4  

Age 

.24 

.44 

.05 

.46 

.49 

Level 

.28 

.47 

.07 

.51 

.54 

Achievement 

.08 

^.12 

.06 

.17 

.17 

Average  Educa- 
tion of  Adults 

.11 

.09 

.04 

.13 

.14 

Commercial 

1.00 

,30 

.10 

.43 

.62 

Batman 

.30 

1.00 

.03 

.57 

.80 

News 

.10 

.03 

1.00 

.05 

*  .27 

Electric 
Company 

.43 

.57 

.05 

1.00 

.87 

Learning  Total 

.62 

.80 

.27 

.87 

1.00 

*The  four  segments  included:    the  commercial  segment,  the 
Batman  segment,  the  news  segment,  and  the  Electric  Com- 
pany segment.    Correlations  are  significant  with  r 
greater  than  .14  at  the  .05  level. 
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Table  5 

Best  Stepwise  Regression  Model  Using 
Total  Learning  Score  as  Dependent 

Variable;  Four  Variable  Model  « 


DF 

Mean  Square 

F 

Prob  >V 

Regression 

Error 

Total 

4 

186 

.  190 

302.93 
11.85 

25.57 

* 

.0001 

B  Value 

'Standard  Error 

Type  II 
Sum  of  Squares 

F 

Prob  >  If 

Intercept 
Achievement 
TV  with  Adult 
Adult  Education 
Level /Age 

16.10 
-1.31 

0.13 
.96 

2.89 

« 

0.35 
0.06 
0.36 

0.31  • 

169.61 
50.08 
84.24 
1047.63 

14.32 
4.23 
7.11 

88.42 

0 

.'0002- 
.0412 
.0083 
.0001 

R  Square  ■  0.55 

t 

\ 
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the  variance  in  learning  test  scores.    Variables  in  the 
model  include  level/age  which  accounts  for  27%,  achieve- 
ment, 3%,  the  education  of  adults  in  the  subjects  home, 
3%,  and  a  subject's  television  viewing  with  adults  for 
3.5%  of  the  variance  in  scores. 

Stepwise  regressions  were  run  using  the  individual 
segment  test  spores  as  dependent  variables.    Three  regres- 
sion models  were  found:    Betty  Crocker  learning  test  score 
with  level/age,  education  of  adults  in  subject's  home, 
and  achievement?  Batman  test  score  with  level/age,  amount  of 
viewing  a  subject  was  reported  as  watching  with  adults, 
and  achievement;  and  Electric  Company  test  score  with 
.level/age,  education  of  adults  in  subject's  home,  amount 
of  viewing  a  subject  was  reported  as  watching  with  adults, 
individual  viewing,  and  achievement.     These  appear  as 
Tables  6,  7,  8,  respectively.    The  models  account  for 
10%  of  the  variance  in  the  Betty  Crocker  commercial  seg- 
ment test  scores,  20%  of  the  variance  in  the  Batman  seg- 
ment test  scores,  and  33%  of  the  variance  in  the  Electric 
Company  segment  test  scores.    No  combinations  were  found 
that  accounted  for  a  significant  amount  of  the  variance 
in  the  news  test  scores. 

Discussion  and  Conclusions 

This  research  was  designed  to  investigate  young 
children's  learning  from  selected  television  program  con- 
tent where  'the  subject  matter  varies  and  to  test  for 
relationships  between  that  learning  and  a  number  of  inde- 
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Table  6 


Best  Stepwise  Regression  Model  Using  Betty  Crocker 
CommerciAj  Segment  Score  as  dependent  Variable; 

Three  Variable  Model 


Regression 

Error 

Total 


DF 


3 

187 
190 


Mean  Square 


8.17 
1.09 


7.46 


B  Value      Standard  Error 


Type  II 
Sum  of  Squares 


Intercept  2.29 

Achievement  -0.18 

Adult  Education  0.21 

Level/Age  0.38 


0.10 
0.10 
0.09 


3.27 
4.63 
18.66 


2. 
4. 
17. 


R  Square  ■  0.10 
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Table  7 


Best  Stepwise  Regression  Model  Using  Batman-  Segment 
Score  as  Dependent  Variable;  Three  Variable  Model 

! 


DF 

Mean  Square 

■    I    •  F 

Prob  >  F 

Regression 

Error 

Total 

3 

1  ft7  * 
10/ 

190 

42.48 
2  75 

15.44 

i  i 

1  ; 

i 

i 
j 

0.0001 

B  Value 

Standard  Error 

Type  II 
Sum  of  Squares 

F 

Prob>F 

__L_ 

Intercept 
Achievement 
With  Adult 
Level /Age 

5.85 
-0.40 

o.os 

0.94 

0.16 
0.03 
0.14 

16.13 
7.41 
112.84  ! 

5.86 
2.69 
41.02 

0.0164 
0.1024 
0.0001 

R  Square  ■  0.20 

• 

I 
I 

I 
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Table  8 


Best  Stepwise  Regression  Model  Using  Electric  Company 
Segment  Score  as  Dependent  Variable; 
Four  Variable  Model 


DF 

Mean  Square 

F 

Prob  >F 

usctcss  ion 

5 

61 . 59 

18.12 

-  X 

0.000V 

Error  N 

185 

3.39 

j 

Total 

190 

■ 

* 

• 

Tvne  TI 

Prob  >  F 

B  Value 

Standard  Error 

Sum  of  Squares 

F 

Intercept 

5.01 

Achievement 

-0.63 

0.18 

39.46 

11.61 

0.0008 

Amount  of  Viewing 

-0.05 

0.05 

4.70 

1.38 

.2410 

With  Adult 

0.11 

0.05 

18.96 

5.58 

0,0192 

Adult  Education 

0.53 

0.19 

25.90 

7.62 

0'.0064 

Level /Age 

1.43 

0.16 

257.21 

75.67 

0.0001 

* 

R  Square  =  0.33 
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pendent  variable?.     It  used  a  learning  measurement  instru- 
ment developed  from  the  selected  television  segments  using 
principles  of  instructional  design.    For  the  purposes  of 
analysis  the  test  items  were  assigned  correct  and  incor- 
rect responses  based  upon     Hi  Central  story  line  and  cog- 
nitive content. 

The  dependent  variable  was  learning  from  the  tele- 
vision material.    The  independent  variables  included: 
age,  level  in  school,  school  achievement,  education  of 
the  adults  in  the  family,  sex,  television  viewing  hours 
with  and  without  an  adult,  birth  order,  and  family  compo- 

« 

sition. 

The  study  was  designed  to  explore  a  number  of  ques- 
tions: 

1)     What  relationship  exists  between  the  amount 
of  time  a  child  watches  television  with  and  without 
adults  and  that  child's  learning  from  television? 

The  amount  of  viewing  that  a  child  does  with  adults 
appears  to  make  a  difference  in  how  well  s/he  understands 
what  is  viewed. 

In  this  study,  parents  reported  how  much  television 
their  child  watched  on  a  daily,  Saturday,  and  Sunday  basis 
with  and  without  them.    Only  eight  adults  reported  that 
their  children  watch  no  television  during  the-  week  with 
an  adult.    Quality  Qf  the  time  adults  spend  viewing  with 
children  was  not  measured.    Many  adults  watching  with 
children  make  no  comment  at  all  during  viewing,  while 
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others  offer  a  running  commentary .    It  has  been  suggested 
that  learning  from  any  medium  can  be  enhanced  by  verbal 
supplements  that  point  out  and/or  reinforce  a  particular 
message.    Verbal  supplements  can  also  distract.  More 
likely  learning  of  specific  television  material  is  depen- 
dent upon  comprehension  of  other  television  viewed  with  or 
without  adults.    Comprehension  is  probably  a  result  of  a 
child's  age  and  his/her  learned  ability  to  learn  from  any 

i  -  - 

t 

medium. 

This  study  took  the  suggestions  of  several  researchers 
(Leifer,  Gordon  &  Graves,  1974;  Adler,  1978;  Heald,  1980) 
that  the  presence  of  a  respected  adult  during  program 
viewing  can  greatly  influence  a  child's  reaction  to  content 
and  measured  the  amount  of  with-adult  viewing  done  by 
subjects  to  see  if  it  would  account  for  any  of  the  variance 
in  scores  on  a  learning  test  from  selected  broadcast  segments. 
This  study  found  that  previous  viewing  with  adults  was 
related  to  a  subject's  learning  test  score  and  accounted 
for  3.5%  of  the  variance  in  scores. 

Although  nothing  conclusive  can  be  said  from  this 
one  study  about  subjects  viewing  with  adults,  other 
than  the  fact  that  a  lot  of  it  goes  on,  there  is  some 
indication  that  adult  viewing  and  what  goes  on  during 
joint  viewing  slightly  improves  children's  ability  to 
learn  from  television. 

2)     What  relationship  exists  between  school  achievement, 
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education  of  parents  and  learning  from  television? 

Subjects  in  this  study  whose  adults  in  the  home  had 
more  education  were  reported  to  watch  less  television 
than  others,  usually  had  fewer  siblings,  did  better  in 
school,  and  learned  more  from  the  selected  television 
programming,  especially  programming  designed  to  teach 
content  traditionally  taught  in  elementary  schools. 

A  significant  negative  relationship  was  found  in  this 
study  between  the  adults'  level  of  education  and  the  amount 
of  television  a  child  was  reported  to  watch.    The  higher 
the  educational  level  of  adults,  the  less  television  s/he 
reported  a  child  tended  to  watch.    This  may  mean  that  the 
more  educated  an  adult,  the  more  s/he  controls  the  tele- 
vision viewing  of  offspring.    According  to  the  adults  in 
their  homes,  the  average  young  child  in  this  study  watched 
about  3.39  hours  of  television  per  day  without  adults 
during  the  school  week.     (See  Table  2  for  raw  data  of 
reported  viewing.)     This  brings  up  an  interesting  point 
about  reported  data.     If  children  are  watching  without  adults 
present,  how  do  those  adults  estimate  that  viewing  time? 
Also,  would  adults  tend  to  report  higher  or  lower  figures 
depending  upon  how  they  wished  to  appear  to  the  researcher? 
I  suspect  some  may  have  as,  after  all,  they  were  told  that 
their  child  would  participate  in  a  study  on  television  and 
the  questionnaire  free  responses  had  a  generally  positive 
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attitude  towards  television.    The  more  educated  the  parents, 
however,  the  fewer  hours  of  television  they  report  their 
children  viewing.    Television  diaries  might  have  been 
a  better  measure,  although  these  are  reports  also.  Subjects 
in  the  study  whose  parents  had  more  education  had  fewer 
siblings,  possibly  because  families  were  delayed  while 
parents  were^in  school.    This  is  also  consistent  with 
established  relationships  between  amount  of  education 
and  family  size.  4 

The  amount  of  television  a  subject  was  reported  as 
watching  was  also  negatively  related  to  school  achievement 
as  ranked  by  the  teachers.    Because  the  school  had  no 
standardized  testing  program,  teacher  rankings  were  used. 
The  validity  of  these  could  be  questioned.    Although  as 
an  estimate  of  a  subject's  class  ranking,  the  teacher 
report  of  school  achievement  is  usable.    This  study 
supports  the  earlier  work  of  Thompson  (1964)  who  found 
a  tendency  for  heavy  viewers  to  be  less  intelligent  and 
to  do  poorly  in  school.    This  should  not  be  thought  of 
as  necessarily  a  causal  relationship.    While  this 
study  found  that  negative  relationship  between  amount 
of  viewing  reported  and  school  achievement,  it  also 
found  a  negative  relationship  between  amount  of  viewing 
reported  and  the  educational  level  of  adults  in  a  subject's 
home.     The  implication  then  that  more  educated  adults 
just  do  not  allow  their  children  to  watch  and  do  not  watch 
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themselves  as  much  television  as  less  Educated  parents. 
More  educated  parents  in  this  study  had  children  who 
ranked  higher  in  school  achievement.    In  this  study  the 
amount  of  viewing  was  in  no  way  related  to  subjects1  perfor- 
mance on  the  television  learning  test.    This  study  found  no 
evidence  to  conclude  that  the  amount  of  viewing  negatively 
affected  learning. 

Both  the  educational  level  of  adults  in  a  subject's 
home  and  the  child's  achievement  level  in  school  were  signi- 
ficantly  related  to  the  learning  score.     It  would  seem 
that  parents  with  more  education  tend  to  monitor  their 
children's  viewing,  have  children  that  do  better  in  school, 
and  are  reported  watching  fewer  hours  of  television.  v 

There  is  some,  although  not  overwhelming,  evidence 
from  this  study  that  children  who  learn  well  in  school, 
learn  well  from  television.    The  relationship  between  a 
child's  school  achievement  and  his/her  learning  score  from 
the  Electric  Company  segment  was  significant.    A  signifi- 
cant relationship  was  not  found  between  school  achievement 
and  the  learning  scores  on  the  other  three  segments. 
Electric  Company,  of  the  four  segments,  being"  most  like 
school,  tended  to  be  understood  best  by  those  who  apparently 
best  understood  school  material.     If  there  had  been  a  rela- 
tionship between  school  achievement  and  learning  from  the 
cognitive  content  of  the  news  story  as  well  as  the  cogni- 
tive content  ef  Electric  Company,  then  it  could  have  been 
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said  that  achievement  in  school  is  related  to  learning 
cognitive  content  from  television  for* this  study.  How- 
ever, from  this  stiudy  it  can  be  concluded  only  that  the 
learning  of  certain  types  of  broadcast  television  material 
usually  taught  in, schools  is  probably  related  to  school 

•  .....  . .  — .  ^ 

achievement.  *  ^ 

3)    What  is  the  relationship  between  sex,  family  size, 
birth  order,  and  learning  from  television? 

Sex,  birth  order  and  family  size  do  not  appear  to 

have  any  relationship  to  how  much  a  child  learned  from 

television  segments  in  this  study  on  a  limited  test  (28 

items)  of  cognitive  content. 

This  study's  failure  to  find  a  relationship  between 
•  ■ « 

family  composition  aqd  learning  from  television  programming 
should  not  be4 interpreted  as  meaning  that  the  family  has 
no  effect.     The  family  structure  and  birth  order  and  its 
impact  on  a  child's  ability  to  learn  should  be  studied  as 
Zajonc  (1977)  suggests.     Tfcis  study  did  not  follow  Zajonc's 
confluency  model  for  iiitellignece  and  birth  order  effects. 
No  conclusions  about  birth  order  can  be  drawn  from  this 
study . 

A  strength  of  this  study  is  that  it  demonstrated  a 
procedure  for  measuring  learning  from  television  material. 
Using  instructional  development  principles,  a  reliable, 
measurement  instrument  for  television  learning  was 
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developed.    This  instrument  was  subjected  to  peer  review, 
review  by  other  instructional  designers  and  teachers,* 
and  was  pilot  tested.    An  item  analysis  was  also  run^ 
after  collection  of  the  data  to  assess  the  difficulty 
and  discrimination  of  the  test  items. 

This  study  concludes  that  the  amount  of  viewing  that 
a  child  does  with  adults  appears  to  make  a  difference  in 
how  well  s/he  understands  what  is  viewed;  that  subjects  in 

o 

this  study  whose  adults  in  the  home  had  more  education 
were  reported  to  watch  less  television  than  others,  usually 
had  fewer  siblings,  did  better  in  school,  and  learned 
more  from  the* selected  television  programming,  especially 
programming  designed  to  teach  content  traditionally    •  .. 
taught  in  elementary  schools;  trat  the  amount  of  viewing, 
se»,  birth  order  and  family  size  do  not  appear  to  have 
any  relationship  to  now  much  cognitively  a  child  learns 
from  television.' 
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Note taking  Aa  «  Learning  Strategy 

f        The  most  prevelant  learning  strategy  used  among  college  level 
learners  is  the  external  learning  strategy  of  notetaking.    An  external 
learning  strategy  is  defined  as  one  involving  an  external  behavioral 
activity  such  as:    writing  paraphrased  ideas,  developing  hypothesis, 
developing  an  illustration  of  a  concept,  the  verbatim  writing  of  the 
presentation,  or  underlining.    While  an  external  strategy  involves  overt 
behavior,  an  internal  learning  strategy  involves  the  covert  mental 
manipulation  of  instructional  information.    A  commonly  used  internal 
strategy  to  aid  learning  is  the  mnemonic  memory  device  (Bower.  1973).  A 
number  of  internal  learning  strategies  involving  covert  mental 
manipulation,  such  as  imagery  mnemonics,  have  teen  investigated  (O'Neil. 
1978;  Rohwer.  1970;  Daneereau,  1979;  Bugelski.  1970;  Paivio.  1970). 
indicating  that  internal  strategies  can  improve  learning.    While  both 
external  and  internal  types  of  learning  strategies  can  be  effective. \ in 
aiding  learning,  the  external  strategy  of  notetaking  is  the  most 
extensively  used  by  college  learners.    A  recent  survey  involving  over  800 
undergraduate  engineering  students,  representing  a  variety  of  engineering 
disciplines,  revealed;  t£et  notetaking  is  the  primary  method  of  abstracting 
information  during  class  for  later  study  (Canelos.  1983).    This  result 
also  seems  to  apply  to  notetaking  activities  during  the  study  of  text 
material  and  other  types  of  printed  instructional  materials. 
Additionally,  undergraduates  seen  to  be  sensitive  regarding  attempts  at 
changing  their  notetaking  behaviors,  if  such  attempts  are  made  to  improve 
notetaking  efficiency.    This  would  indicate  that  undergraduate  students 
are  conscientious  about  note taking,  and  therefore  consider  notetaking 
strategies  vital  to  their  learning.    For  example,  after  using  an 
innovative  teaching  strategy,  aimed  at  improving  notetaking  during 
lectures.  Kilareski.  Canelos.  and  Reinschmidt  (1982)  found  that  students 
had  strong  attitudes  regarding  the  new  notetaking  strategy. 

While  the  notetaking  strategy  appears  to  be  extensively  used  by 
learners,  little  is  actually  known  about  what  types  of  notetaking 
strategies  are  better  for  acquiring  specific  types  of  intellectual  skills 
such  as:     factual  learning,  conceptual  learning,  rule  application,  and 
problem  solving.    Furthermore,  past  research  does  not  yield  a  great  deal 
of  information  regarding  how  notetaking  is  operationally  contributing  to 
the  learning  process  from  a  cognitive  processing  perspective  (Ganske , 
1981).    The  present  study  attempts  to  address  this  problem  by 
operationally  defining  a  notetaking  strategy  as  a  method  of  separating 
relevant  to-be-learned  material  from  background  information  given  in 
instruction.    This  separation  of  relevant  material  for  a  specific 
intellectual  skill,  from  irrelevant  material  seems  to  be  the  key 
information  processing  function  of  the  potetaking  activity.    Hartley  and 
Davies  (1976)  indicated  three  functional  activities  involved  in 
notetaking: 

1.  identify  and  discriminate  elements; 

2.  identify  and  discriminate  the  relationships  of  those 
elements; 

3.  identify  how  information  is  organized  (Hartley  and 
Davies.  Note  1.  p.  27). 
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The  first  two  of  these  activities  involve  the 'behavior  of  separating  what 
is  relevant,  and  must  be  learned,  from  what  is  background  information  in 
the  lesson. 


The  note taking  strategy  used  in  the  present  study  was  called  the 
directed  overt  activity  strategy  (DQA).    The  DQA  note taking  strategy  aided 
the  learner  in  separating  relevant  information  that  had  to  be  learned  from 
irrelevant  information.    Learning  performance  using  the  DQA  strategy  was  ' 
evaluated  on  three  types  of  intellectual  task*:    spatial  learning,  simple 
concept  learning,  complex  concept  learning.    The  performance  of  subjects  / 
using  the  DOA  notetaking  strategy  was  compared  to  subjects  using  their  own 
covert  internal  learning  strategy,  while  learning  from  printed 
instructional  materials.    The  printed  instructional  materials  consisted  of 
a  workbook  providing  information  about  the  human  heart.    The  printed 
information  in  the  booklet  waa  complemented  with  drawings  of  the  heart; 
There  were  two  typea  of  booklets.    The  printed  information  was  identical 
in  both  booklet  types,  in  terms  of  content  and  organisation.    However,  one 
booklet  contained  an  illustration  type  drawing,  and  the  other  a  line 
drawing.    The  instructional  content  in  the  booklets  was  designed  to  teach 
the  names  of  the  parts  of  the  heart,  and  how  the  parts  interact  during 
heart  operation,  and  the  blood  flow  sequence  during  heart  operation* 


Experimental  Design  and  Procedures 

The  experimental  design  of  this  study  was  a  2x2x3  analysis  of 
variance,  having  two  between-subjects  variables  and  one  within-subjects 
variable.    The  first  between-subjects  variable  was  type  of  notetaking 
strategy:    directed  overt  activity  strategy  (DQA)  and  the  covert  activity 
strategy  (CA).    The  second  between-subjects  variable  was  type  of 
instructional  booklet:    line  drawing  instructional  booklet  and 
illustration  instructional  booklet.    The  within-subjects  variable  was  type 
of  intellectual  task:    spatial  learning  task,  simple  concept  learning 
task,  and  complex  concept  learning  task.    The  intellectual  tasks  were 
measured  by  three  separate  tests:     identification  test,  terminology  test, 
and  comprehension  test. 

The  first  level  of  the  notetaking  strategy  variable  was  the  DOA 
notetaking  strategy.    Subjects  in  this  condition  were  trained  on  how  to 
use  the  DOA  strategy  in  a  10-minute  training  period  prior  to  receiving  the 
instructional  treatments.    The  purpose  of  the  DQA  strategy  was  to  improve 
the  learner's  ability  to  abstract  relevant  information  from  the 
instructional  booklet,  for  later  performance  on  the  three  intellectual 
tasks.    The  key  to  the  DOA  strategy  was  to  get  the  learner  to  actively 
respond  to  the  information  in  the  printed  instructional  materials.  To 
accomplish  this,  the  DOA  strategy  required  the  learner  to  respond  on  a 
notetaking  sheet  while  reading  through  the  instructional  booklet.  The 
notetaking  sheet  consisted  of  an  8x11  sheet  with  a  drawing  of  the  heart 
centered  and  filling  up  about  two  thirds  of  the  sheet.    The  drawing  of  the 
heart  was  a  bl own-up  version  of  exactly  what  was  found  in  the 
instructional  booklet  except,  of  course,  no  labels,  arrows,  or  text  was 
provided.    There  were  two  types  of  notetaking  aheets:    an  illustration 
sheet  for  those  subjects  using  the  illustration  drawing  booklet,  and  a 
line  drawing  ahaet  for  those  subjects  using  the  line  drawing  booklet.  In 
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addition  to  active  responding,  the  note taking  sheet  provided  the  necessary 
structure  for  helping  the  learner  concentrate  on  the  ?«.-be-learned 
information  in  the  instructional  booklet. 


The  learner  was  instructed  to  use  the  nr.tetaking  sheet  in  the 
following  way.    First,  while  reading  through  the  instructional  booklet, 
when  a  heart  part  nose  and  location  waa  described  the  name  was  to  be 
written  on  the  note taking  sheet  near  the  correct  location.    Secondly,  an 
arrow  was  to  be  drown  indicating  the  exact  spatial  location  of  the  part. 
Thirdly,  the  instructional  booklet  described  the  interaction  of  the  parts 
during  heart  operation,  this  information  was  "relevant  and  should  be 
learned.    The  learner  was  instructed  to  draw  a  double-headed  arrow 
indicating  the  set  of  two  or  three  parts  of  the  heart  that  interact  during 
a  apecific  heart  operation.    For  example,  the  superior  and  inferior- vena 
cava  fills  up  the  right  auricle,  forcing  open  the  tricuspid  valve.  Thus 
an  arrow  would  be  drawn  from  the  superior  and  inferior  vena  cava  through 
the  right  auricle  to  the  tricuspid  valve.    This  procedure  would  be  done 
while  reading  the  instructional  booklet  until  all  the  interacting  parts 
were  identified.    Finally,  it  was  important  for  the  learner  to  understand, 
the  blood  flow.    So  the  subject  was  instructed  to  draw  a  dotted  line 
through  the  major  portions  of  the  heart  «.o  indicate  blood  flow.  The 
second  level  of  the  notetaking  strategy  variable  was  the  covert  activity 
strategy  (CA).    The  CA  strategy  required  the  subject  to  read  through  the 
instructional  booklet  and  attempt  to  process  as  much  information  as 
possible  from  the  instructional  booklet.    The  CA  strategy  allowed  the 
learner  to  us*  his  or  her  own  information  processing  or  learning  strategy 
that  is  typically  used  during  academic  learning.    Since  many  college 
level  learners  have  developed  learning  strategies  on  their  own,  it  is 
likely  that  these  innate  strategies  could  be  as  effective  as  a  learning 
strategy  imposed  during  the  instructional  situation. 

The  second  between-subject 8  variable  was  the  type  of  instructional 
booklet  used  during  learning.    There  were  two  levels  of  the  instructional 
booklet  variable:    line  drawing  booklet,  and  illustration  drawing  booklet. 
A  variety  of  visual  types  are  used  to  complement  printed  instructional 
materials,  it  is  is  likely  that  visual  complexity  could  effect  learning 
and  the  overall  effectiveness  of  the  DOA  strategy  or  CA  strategy. 


The  with in-subject s  variable  was  type  of  intellectual  task.  The 
spatial  learning  task  was  tested  by  the  identification  test.  The 
identification  test  was  a  20-item  multiple  choice  test  designed  to  test 
the  spatial  learning  of  heart  part  location.    The  test  contained  an 
illustration  drawing  of  the  heart  with  numbers  where  each  part  was  located. 
The  20  items  sppeared  under  the  numbered  drawing  and  were  all  worded  in 
the  following  manner: 


Arrow  number  4  points  to  the 

a.  pulmonary  vein 

b.  pulmonary  artery 

c.  aorta 

d.  tricuspid  valve 

e.  mitral  valve 
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The  spatial  Learning  intellectual  task  was  considered  the  easier   of  the 
three  tasks.    The  simple  concept* learning  .task  was  tested  by  the 
terminology  test.    The  terminology  test  was  a  20  item  multiple  choice  test 
Each  item  gave  a  critical  attribute  about  a  heart  part  or  operation  and 
the  subject  hsd  to  identify  the  part  or  operation.    The  items  on  the 
terminology  test  ware  worded  in  the  following  manner: 

The -tisane  which  protects  the 
inside  lining  of  the  pericardium 
ib  celled  the  . 

a.  ex toxin 

b.  epicardium 
c  endocardium 
d.  myocardium 
6t  ectocardium 

The  simple  concept  learning  task  was  considered  of  intermediate 
difficulty,  between  the  spatial  learning  task  and  complex  concept  learning 
task*    The  complex  concept  learning  task  was  tested  by  the  20-item 
comprehension  test.    Each  item  on  the  comprehension  test  vaa  designed  to 
test  the  learner 1 s  knowledge  of  how  the  parts  interact  during  heart 
functioning.    The  items  on  the  test  involve  the  interaction  of  two,  three , 
or  more  simpler  concepts  about  the  heart*  thus  the  name  complex  concept 
learning.    The  comprehension  test  is  considered  the  most  difficult  of  the 
three .  and  items  on  this  test  were  worded  in  the  following  manner: 

When  impure  blood  is  entering  the 
superior  vena  cave,  it  is  also  ' 
entering  the: 
s.    pulmonary  veins 

b.  aortic  arch 

c.  inferior  vena  cava 

d.  pulmonary  artery 

Subjects  for  the  study  were  freshman  psychology  students  from  Ohio 
State  University.    Subjects  participated  in  the  study  on  a  voluntary  basis 
and  received  credit  toward  their  final  grade  in  their  , basic  psychology 
course  for  participation.    One  hundred  subjects  signed,  up  for  the  study. 
All  subjects  were  given  a  pretest  on  human  physiology  and  no  subject  had  a 
score  in  excess  of  35X  correct  on  the  pretest.    Subjects  were  randomly 
distributed  to  type  of  instructional  booklet,  with  50  subjects  in  each  of 
the  two  groups;  illustration  drawing  booklet  and  line  drawing  booklet. 
From  there,  subjects  were  randomly  distributed  to  type  of  note taking 
strategy;  DOA  or  CA.    In  each  of  the  two  groups  of  instructional  booklet, 
25  subjects  used  the  DOA  strsteyy,  and  25  subjects  used  the  CA  strategy. 
Four  separate  classrooms  were,  used  so  that  each  group  of  25  subjects  had 
no  way  of  knowing  what  was  going  on  with  the  other  groups.    Subjects  in 
the  DOA  groups  were  given  training  on  how  to  use  the  DOA  strategy  during 
the  first  10  minutes  of  their  session.    A  set  of  instructions  was  read  to 
the  DOA  groups  on  how  to  use  the  strategy,  so  each  of  the  two  groups 
received  identicsl  instruction.    The  instructional  booklets  and  note taking 
sheets  were  then  administered  and  subjects  had  25  minutes  to  study  the 
booklets  while  using  the  DOA  strategy.    At  the  end  of  the  25  minute  study 
period,  all  instructional  booklets  and  note taking  sheets  were  collected 
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and  the  test  battery  of  three  tests  was  administered.    Subjects  were  given 
45  minutes  to  complete  the  test  battery.    Subjects  is  the  CA  strategy  were 
told  to  use  their  normal  study  strategy  whan  studying  the  instructional 
booklet.    This  was  explained  as  the  typical  study  strategy  they  use  when 
in  a  lecture  or  studying  textbook  material  on  their  own.    The  CA  subjects 
were  then  given  23  minutes  to  study  the  instructional  booklet.    At  the  end 
of  the  25  minute  period,  all  instructional  booklets  and  any  written  notes 
were  collected  by  the  experimenters.    The  test  battery  was  then 
administered,  subjects  were  given  45  minutes  to  complete  the  test  battery. 


Results 

The  resulting  analysis  of  variance  appears  in  Table  1.  Statistically 
significant  results  failed  to  occur  on  the  two  between-subjects  variables 
of  strategy  and  instructional  booklet  and  their  interaction.  This 
indicated  that  the  visual  type  difference  of  line  drawing  or  illustration 
did  not  effect  learning  and  had  no  effect  on  strategy  type  used..  However, 
there  was  a  significant  interaction  between  intellectual  task  and 
strategy,  which  could  account  for  the  lack  of  statistical  difference 
between  the  overall  DQA  mean  and  GA  mean.    The  wi thin-subjects  variable  of 
intellectual  task  yielded  a  statistically  significant  F-ratio  (F(2,192  Df) 
-  64.701,  {K.000D.    A  Tukey  follow-up  test  set  at  a  significance  level  of 
.01  was  conducted  to  find  the  mean  differences  between  the  spatial  task, 
the  simple  concept  task,  and  the  complex  concept  task.    The  spatial  task 
mean  (x  -  14.06)  differed  significantly  from  the  simple  concept 
task  mean  (x  -  11.56)  and  the  complex  concept  task  mean  (x  ■  10.65). 
The  simple  concept  mean  did  not  differ  significantly  from  the  complex 
concept  task  mean.    This  result  indicated  that  the  spatial  task  was  in 
fact  the  easier  of  the  three  intellectual  .tasks.    While  the  difference 
between  the  simple  concept  task  mean  waa  not  statistically  different,  the 
complex  concept  mean  (x  *  10.65)    was  lower  than  the  simple  concept  mean  of 
(x  -  11.56)    indicting  that  the  complex  concept  tank  was  slightly  more 
difficult. 

The  interaction  between  the  strategy  variable  and  intellectual  task 
variable  resulted  in  a  significant  F-ratio  (F(2,192  Df)  -  15.523,  p<.04). 
The  means  involved  in  the  significant  interaction  appear  in  Table  2.  The 
significant  interaction  is  graphically  displayed  in  Figure  1.    A  Tukey 
follow-up  test,  with  a  significance  level  of  .05,  was  conducted  on  the 
resulting  means  to  locate  the  source  of  the  interaction.    Looking  at  the 
DOA  strategy  level  finds  a  statistical  difference  between  the  spatial  task 
mean  (x  *  13.9)  and  both  the  simple  concept  task  mean  (x  »  11.16)  and 
the  complex_concept  task  mean  (x  ■  11.02).    However,  the  simple  concept 
task  mean  (x  -  11.16)  and  complex  concept  task  mean  (x  *  11.02)  did 
not  differ  statistically.    Looking  at  the  CA  strategy  finds  the  source 
of  the  interaction.    Similar  to  the  DOA  level,  at  the  CA  level  the  spatial 
task  mean  (x  -  14.22)  differa  significantly  from  both_the  simple  concept  task 
mean  (x  -  11.96),  and  the  complex  concept  task  mean  (x  -  10.28). 
However,  unlike  the  DOA  level,  at  the  CA  level  there  is  s  statistical 
difference  between  the  simple  concept  mean  (x  -  11.96)  and  the  complex 
concept "mean  (X  -  10.28).    The  source  of  the  interaction  ia  this  difference 
between  the  simple  concept  mean  and  complex  concept  mean  at  the  CA  strategy 
level. 
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This  malt  indicate*  that  as  intellectual  task  difficulty  increased 
subjects  using  the  DOA  strategy  had  an  information  processing  advantage 
over  subjects  in  the  CA  group  using  their  own  innate  strategy.  Subjects 
using  their  own  strategy  in  the  CA  group  performed  quite  well  on  the 
spatial  learning  taak  and  simple  concept  learning  task.    However,  the  DOA 
group  was  able  to  abstract  and  retain  sore  information  from  the 
instructional  booklet  about  how  the. parts  of  the  heart  interact  during  the 
hearts  operation  than  the  Ca  group,    while  both  groups  perfcrssd  well  at 
the  less  difficult  side  of  the  intellectual  task  scale,  the  DOA  strategy 
allowed  subjects  to  identify  important  information  to  help  them  perform  on 
the  more  difficult  intellectual  task. 


Conclusions  and  Further  Research 

The  directed  overt  activity  noteteking  strategy  addressed  three  key 
elements  that  facilitated  the  cognitive  processing  of  information.  First, 
the  use  of  the  noteteking  sheet  provided  a  structure  for  the  learner  to 
help  effectively  organise  new  to-be- learned  information.    As  Hartley  and 
Davie*  (1976)  indicated,  thia  organising  principle  is  a  significant  aspect 
of  learning  via  noteteking.    Secondly,  the  DOA  strategy  directed  the 
learner  to  identify  relevant  information  from  the  instructional  booklets 
that  would  be  needed  to  successfully  perform  on  the  three  intellectual 
tasks.    Thus  the  learner  is  not  left  to  his  or  her  own  decision  making,  as 
is  often  the  case,  on  identifying  what  should  be  learned  and  what  will  be 
needed  for  test  performance.    Finally,  the  DOA  strategy  forces  th«  learner 
to  be  intellectually  ective  during  the  study  phase  of  learning.  The 
learner  is  not  passively  reading  or  passively  taking  notes,  but  must  be  ' 
active  intellectually  to  complete  the  noteteking  sheet  while  interacting  ■ 
with  the  instructional  materials.    The  CA  strstegy  and  DOA  strategy 
probably  did  not  differ  on  the  less  difficult  intellectual  tesks  because 
the  CA  group's  own  study  strategies  were  relatively  effective.    Keep  in 
mind  here  that  the  subjects  were  all  beginning  college  level  students  who 
must  have  developed  reasonably  effective  study  strategies  for  this  level 
of  academic  development.    It  is  likely  that  high  school  and  technicel 
school  students  may  benefit  more  from  such  imposed  stretegies.    However  ae 
intellectual  tesk  difficulty  increased,  even  slightly,  the  DOA  strstegy 
group  significantly  outperformed  the  CA  group. 

Of  course,  in  this  study  the  noteteking  sheet,  intellectual  tasks, 
and  printed  instructional  materials,  were  matched  on  a  one-to-one  basis, 
however  the  basic  elements  involved  in  the  DOA  strstegy  could  be  used  for 
almost  sny  type  of  print  or  lecture  instructional  materials.    This  would 
require  the  instructor  to  develop  some  type*  of  noteteking  sheets  or 
handout  packs  for  each  lecture.    The  noteteking  sheets  would  provide  the 
orgenisetion  or  structure  needed  to  effectively  interact  with  the  lecture. 
Of  course',  learners  would  have  to  be  given  instructions  on  bow  to  interect 
with  the  noteteking  sheets  and  the  lecture.    Finally,  it  would  be 
'necessary  to  organise  the  lecture  quite  well,  and  pace  the  lecture  ao 
students  csn  follow  along  and  continue  to  respond  on  their  noteteking 
sheets.    This  type  of  noteteking  strategy,  to  aid  the  learner  in  acquiring 
information  during  the  lecture,  has  been  tried  et  Penn  Stete  Engineering 
in  e  Civil  Engineering  course  (Kilereski,  Canelos,  Seinschmidt,  1982).  In 
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this  Civil  Engineering  course*  *  supplementary  text  was  developed  that 
consisted  of  a  series  of  noteteking  sheets  for  each  lecture.  These 
note  taking  sheets  required  the  learner  to  write  in  definitions,  complete 
equations,  solve  simple  problems ,  solve  complex  problems,  end  complete 
diagrams,  during  the  50-minute  lecture.    Some  of  these  activities  were 
simple  "fill  in  the  blank"  type  of  tasks;  others  required  complex  problem 
solving.    However,  the  key  here  is  that  the  noteteking  sheets  kept 
learners  intellectually  active  during  the  lecture,  provided  a  structure, 
and  identified  important  material  that  should  he  learned.    Both  students 
end  faculty  responded  quite  well  to  the  Civil  Engineering  course 
noteteking  methodology. 

A  similar  noteteking  approach  waa  developed  for  an  Engineering 
Science  end  Mechanics  course  at  Peon  State  Engineering  (Fytel,*1984).  In 
thia  course,  the  noteteking  aheeta  were  designed  to  complement  television 
instructional  mater iala.    They  were  referred  to  aa  Lecture  Botes  and  were 
developed  into  e  workbook  format.    The  purpose  of  the  Lecture  Motes 
workbook,  in  the  Engineering  Science  end  Mechanics  course,  waa  to  insure 
thst  students  would  be  ective  while  viewing  the  television  lessons. 
Similer  to  the  Civil  Engineering  methodology,  the  Lecture  Botes  required 
students  to  write  in  definitions,  complete  equations,  develop 
illustrations  and  diagrams,  and  solve  simple  problems.    In  the  Engineering 
Science  and  Mechanics  course,  students  responded  quite  favorably-. to.  the 
Lecture  Notes,  and  the  method  does  improve  learning  from  the  Engineering  ' 
Science  and  Mechanics  television  instructional  materials. 

These  two  epplied  examples  of  the  use  of  a  DOA  type  of  noteteking 
atrategy  further  confirms  the  positive  effects  upon  looming  of  a 
noteteking  strategy  designed  to:    keep  students  intellectually  active 
during  the  instructional  sequence,  point  out  relevant  to-be- learned 
materiel,  and  provide  e  structure  or  organising  principle.  Further 
studies  in  this  eree  should  consider  the  effects  of  similar  noteteking 
strategies  when  learning  from  different  presentation  modes  such  aa  lecture 
aethoda,  video  based  instruction,  and  computer  based  instruction. 
Additionally,  since  it  is  likely  that  high  school  and  technical  school 
students  would  benefit  from  learning,  noteteking  Strategies,  such 
strategies  should  be  further  refined  and  tested  using  such  students  as 
subjects.    Most  high  school  level  students  have  not  yet  developed  learning 
and  noteteking  strategies  that  are  effective  and  efficient.  Further, 
primary  level  students  and  junior  high  level  students  would  also  benefit 
greatly  from  learning  effective  noteteking  stretegies  if  they  were 
available.    It  has  alweys  been  an  emasing  paradox  that  so  much  is  known 
about  learning  strategies,  of  an  external  end*  internal  nature,  but  few 
students  are  ever  given  formal  Instruction  on  these  "learning  how  to 
learn"  methodologies.    Perhsps  further  applied  research  would  tend  to 
correct  this  serious  pedagogical  problem. 
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Table  I:      Resulting0  Analysis  of  Variance. 


Source 

'*■  Mean  Squares 

Df 

f- Ratio 

Probability 

Strategy  (A) 

1.203 

1 

5.029 

.86 

Booklet  (B) 

 J  76.003 

1 

1.813 

.  .18 

(A)  s  (B) 

42.563 

1 

1.021 

.31 

error 

41.681 

V 

96 

* 

— 

i 

.    L 

• 

Intellectual 

Task  (C) 

311.7^0 

•2 

64.701 

.0001 

(A)  x  (C) 

15.523 

2 

3.222 

.042 

(B)  x  (C) 

4.263 

2 

0.885 

.41 

(A)  x  (B)  x 

(C)  3.523 

2 

0.731 

.48 

error. 

4.819 

192 

• 

Table  2:     Strategy  by  Intellectual  Task  Interaction  Table  of 
Means 

& 

i 


1  1 

I                     1  Spatial 

Simple  Concept 

Complex  Concept 

1 

Task 

Task 

Task 

1  D0A 

13.90 

11.16 

11.02 

I  ' 

14.22 

11.96 

10.28 

S 

■ 
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Statement  of  the  Problem 

Muoetors  have  recently  bNB  faced  with  the  task  of  meting  the  demands 
of  society  to  odueoto  students  so  that  thoy  become  computer  literate.  In 
1*83,  the  •Haiion  at  Risk"  report  of  the  Rational  Coamisalon  on  Excellence  in 
Education  recommended  that  computer  science  -be  required  of  all  secondary  school 
students  (Batioaal  Coaaission  on  Excellence  in  Education,  1983).   An  extensive 
reriew  of  the  literature  revealed  that  eany  public  school  districts  vers  deve- 
loping eoaputer  literacy  prograas  and  expecting  students  to  beooae  eoaputer 
literate.   In  addition,  aany  higher  educational  institutions  had  Instigated 
eoaputer  literacy  requirements  for  graduation.    However,  there  were  no  known 
standards  for  determining  what  aapeots  of  eoaputer  literacy  should  be  taught 
at  various  levels  of  education,/  and  no  effective  means  of  measuring  the  level 


of  computer  literacy  posseesed 


at  various  levels  of  education.    A  standardised 


measure  of  computer  literacy  was  needed  to  facilitate  the  development  of 
computer  literacy  courses  that  were  appropriate  to  the  needs  of  the  students. 
Such  an  instrument  would  be  critical  for  providing  students  with  instruction 
*    and  experiences  suited  wo  their  level  of  computer  literacy. 


Purpose  of  the  Study 

\ 

The  purpose  of  this  study  was  to  construct  a  valid  and  reliable  criterion- 
referenced  instrument  to  assess  the  computer  literacy  (knowledge,  skills,  atti- 
tudes) of  students.    Three  primary  purposes  for  the  Standardised  Test  of  Computer 
Literacy  (STCL)  were  identified. 

1.  To  document  the  computing  competencies  of  students  and  to  coll  sot 
normative  data  about  various  subgroups  of  students. 

2.  To  Justify  revisions  in  the  consent  *  f  computing  courses  to  reflect 
student  needs. 


\ 


XTo  provide  criteria  for  the  placeaent  of  students  in  appropriate 
computing  courses  based  on  tnWir  level  of  computer  literacy. 

.  Methodology 


The  proeeduree  followed  in  the  development  of  the  STCL  were  d*eigned 

to  contribute  positively  to  the  overall  validity  and  reliability  of  the 

instrument.   A  twelve  step  model  for  the  development  and  validation  of 

oriterion-referenoed  teete  was  used  as  a  guide  for  the  development  of  the  STCL. 

She  methodology  included  the  following  eteps  (Hambleton,  198o)t 

A*    Preparation  sad/or  seleotion  of  objectives. 

Preparation  of  test  domain  specifications. 
3.    writing  teet  items  "matched"  to  objectives. 
U.   Preliminary  review  of  test  items. 

5.  Determination  of  content  walidity  of  the  test  itema. 

a.  Involvement  of  content  speoislists. 

b.  Collection  and  analysis  of  examinee  response  data. 

6.  additional  editing  of  test  items. 

7.  Test  assembly. 

8.  Setting  standards  for  interpreting  examinee  test  performance. 
/.    Test  administrations  to  criterion  groups. 

10.  assessment  of  test  score  reliability  and  validity f    compilation  of  test 
score  horse. 

11.  Preparation  of  a  user's  manual  and  a. technical  manual. 

12.  Periodic  collection  of  additional  technical  information. 

The  f iret  etep  in  the  development  of  the  STCL  involved  defining  the 
domain  of  content  (computer  literacy)  to  be  measured  by  the  instrument  and 
identifying  appropriate  computer  literacy  objectives  or  competencies,    a  review 
of  the  literature  was  conducted  to  determine  a  definition  of  computer  literacy , 
identify  computer  literacy  competencies,  and  identify  any  existing  test  items 
or  instruments  measuring  computer  literacy.    The  following  definition  was 
adopted  i 

Computer  literacy  is  operationally  defined  as  an  understanding 
of  computer  characteristics,  capabilities,  and  applications,  ss 
well  as  an  ability  to  implement  this  knowledge  in  the  skillful, 
produotivs  use  of  computer  applications  suitable  to  individual 
roles  in  society.   The  knowledge  and  skills  of  computer  literacy 
as  defined  shore  have  been  divided  into  four  major  categories; 
computer  attitudes,  computer  systems,  computer  applications,  and 
computer  programming.    Thess  four  sections  are  defined  below. 
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1.  Computer  Attitudes  refer  to  an  individual'e  feelings  about  tha 
personal  ana  aoeiatal  nee  of  computers  in  • 
Positive  attitude,  include  an  anxiety  free  willingneee  or  desire 
to  uss  tha  oomputsr,  eonfidanea  in  ona'a  abilities  to  naa  tha 
computer,  and  computer  responsibility, 

2.  Computsr  Systems  rsfer  to  tha  ^^^J^l^^ 
equipment  (hardware)  and  programs  (software)  neoeesary  for  computsr 
applications.   IMi  require  underetandlng  and  abilitiaa  toga 
following  araaat   computer  functions,  computer  hardvara,  computer 


software,  computer  systems  configuration,  ooayatar  tamtoology 
hiatorieal  development,  and  tha  operation  of  computere. 

3.   Computer  Applicetione  refer  to  the  ability  to  reaj>onaibly  evaluate, 
eeleet,  and  implement  a  variety  of  practical  computer  applicatione 
to  do  meaningful  and  effioient  work  baaed  on  an  understanding  of 
tha  following!   general  typee  of  applicatione.  capabilitiee  and 
limitatione  of  applioatione,  aooietal  impact  (paat,  preeent,  and 
future),  evaluation  and  eeleotion  teobmlquse,  and  apecifio  appli- 
oatlona  (word  prooeeeing,  data  base  mansgsmsnt,  spreadabmet/f  Jaan- 
eial  management,  statistical  analysis,  graphics,  and  educational 
applications). 

U.    Conputer  Programming  refers  to  the  ability  to  direct  the  operation 
of  the  conputer  through  the  ekillful  use  of  programming  languages 
(high  level  aa  well  aa  aoftware  languages),   This  rejtoi  an 
understanding  of  problem  aolving  strategiee,  algorithma  and  flow- 
eharta,  languages,  and  programming  skills. 

Bext,  computer  literacy  cempeteneiee  were  collected  from  a  variety  of 
aouroes,  such  aa  computer  literacy  course  outlines,  curriculum  guides,  text- 
books, and  computer  literacy  reaearch  studiea  reported  in  the  literature. 
-The  Computer  Literacy  Objectives",  developed  aa  part  of  the  Computer  Literacy 
Study  conducted  by  the  Minnesota  Educational  Computing  Consortium  (Klaasen  et 
al.,  1980),  were  reviewed  and  accepted  for  the  initial  list  of  computer 
literacy  competenoiee. 

in  attempt  was  made  to  ensure  a  mors  comprehensive  and  valid  list  of 
competencies  for  the  STCL  domain  specifications.   A  survey  was  sent  to  327 
computer  education  specialists.   Bach  computer  specialiat  was  asked  to  read 
the  purpose  of  the  STCL  and  the  operational  definition  of  computer  literacy, 
and  then  write  two  computer  literacy  cempeteneiee  for  each  of  ths  four  aeoticne 
of  the  definition.   The  computer  spscislists  were  selected  from  the  following 
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1.  At  participants  of  the^Hetional  Computer  Literacy  Goals  lor  1985 
Conference  (Soidel,  Anderson,  and  Banter,  1932). 

2.  Hw  presenters  at  the  Rational  Educational  Computing  Conference  of 
1982  (Smith  and  Mourn,  1982). 

3.  Computer  Consultants  listed  In  the  1983  Clsssrooa  Computer  fews. 
Directory  of  Educational  Computing  Resources.  Fart  III  J  local 
and  Regional  Resources  (Kslaan,  19o.".,. 

li.   The  aembQTS  of  the  International  Council  for  Computers  in  Education, 

listed  in  the  April  1983  issue  of        Coanmtlng  Teacher  (Moursund,  1983). 

5.   lanes  of  instructors  derived  Iron  a  listing  of  colleges  and  univer- 
sities offering  sassier  school  coaputer  courses  in  the  March  1982 
issue  of  *£&  Computing  Teacher  (Moursund,  1982). 

The  list  of  coaputer  literacy  competencies  obtained  from  approximately 
90  computer  specialists  who  responded  to  the  survey  was  then  combined  with  the 
list  of  competencies  identified  from  the  literature.    A  tally  of  each  discreet 
competency  was  made  by  counting  the  number  of  individuals  who  mentioned  each 
competency.    The  entire  list  of  competencies  was  then  reviewed  by  the  STCL 
steering  committee.    A  total  of  87  competencies  were  selected  for  inclusion 
in  the  STCL  domain  specifications  based  on  the  following  criteria  (Klein  and 
Kosecoff,  1973)i    transferability  within  the  domain,  widely  accepted  by  content 
specialists,  terminal ity,  transferability  outside  the  domain,  and  ease  of 
seorability.    The  competencies  were  then  categorised  into  the  four  sections 
of  the  definition  (nine  for  computer  attitudes,  21*  for  computer  systems,  33 
for  computer  applications,  and  21  for  computer  programming). 

The  review  of  the  literature  revealed  three  valid  and  reliable  computer- 
related  instruments  that  were  reviewed  for  possible  inclusion  in  the  STCL. 
"The  Minnesota  Computer  Literacy  and  Awareness  Assessment"  (Xlaasen  et  al.»  1980), 
The  Computer  Anxiety  Index  (CAIH)  (Hsurer,  1983),  and  the  Beliefs  About  Computers 
Scale  (BACS)  (Ellsworth  and  Bowman,  1982)  were  reviewed  to  determine  if  any 
portions  of  the  instruments  ware  consistent  with  the  computer  literacy  defini- 
tion and  competencies  for  the  STCL. 
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It  mi  the  opinion  of  ttao  steering  committee  that  "The  Minnesota  Computer 
Literacy  and  Awareness  Assessment"  did  not  contain  test  items  that  vers  appro- 
priate for  the  STCL.   Most  of  the  items  on  the  Minnesota  instrument  were  know- 
ledge  or  comprehension  level  questions.    One  of  the  goals  identified  by  the  STCL 
steering  ooamittee  was  to  develop  an  instrument  that  included  test  items  that 
messursd  high  lerel  cognitive  skills  as  identified  by  Bloom's  Taxonomy  of  Edu- 
cational Objectives  (Bloom,  Engl  chart,  Hill,  and  Kratbwohl,  1956).    An  attempt 
was  made  to  develop  an  Instrument  that'  measured  high  level  computer  literacy 
skills,  such  as  application,  analysis,  synthesis  j,  and  evaluation  skills*  The 
Minnesota  instrument  seemed  to  measure  only  knowledge  and  awarenees  aspeots  of 
computer  literacy  as  defined  for  the  STCL.    The  STCL  steering  committee  concluded 
that  higher  level  items  could  be  written  to  measure  computer-related  skills. 

The  CAIN  (Maurer,  1983)  and  the  BACS  (Ellsworth  and  Bowman,  1982)  were 
considered  to  be  appropriate  for  the  computer  attitudes  section  of  the  STCL. 
Both  of  these  instruments  consisted  of  Likert-type  items  and  were  shown  to  be 
valid  and  reliable  measures  of  students'  attitudes  and  anxiety  towards  computers. 
The  CAIH  is  a  twenty-six  item  scale  with  a  test/re  test  reliability  of  0.90  and 
an  internal  consistency  reliability  estimate  of  0.9U  (Maurer,  1983)*    The  BACS 
la  a  seventeen  item  seals  with  a  test/retest  reliability  of  0.85  and  an  inter- 
nal  consistency  reliability  of  0.77  (Ellsworth  and  Bowman,  1982). 

a 

Domain  specifications  for  the  STCL  were  developed  based  on  the  suggestions 
proposed  by  Fopham  (1980)  and  others  (Berk,  1980$  Mlllman,  197U?  Hlvely  et  al., 
1968).    The  Domain  specifications  contained  a  description  of  the  purpose  of  the 
instrument,  the  definition  of  computer  literacy,  the  list  of  competencies,  guide- 
lines for  writing  effective  multiple  choice  items,  and  sample  items. 
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The  STCL  domain  speoif icatioas  vm  distributed  to  a  team  of  fifteen 
ooaputor  literacy  specialists  la  the  department  of  Prof  essional  Studies  la 
{  Education  at  Iowa  State  Univsrsity.   Bach  apeoialiet  was  aeked  to  write 
multiple  ohoioe  questions  for  tea  or  eleven  of  the  competencies  in  the  Computer 
Systems,  Computer  Applications*  sad  Computer  Programming  sections  of  the  STCL. 
Two  questions  were  written  for  saoh  competency  in  the  three  sections  mentioned 
above.   This  produced  a  total  of  186  test  questions.   The  test  itsm  writers 
were  eaoouraged  to  iaoorporate  diagrams,  illustrations*  and  other  creative 
devices  into  appropriate .  questions  to  ensure  a  variety  of  test  items  at  all 
levels  of  Bloom's  Taxonomy  of  Educational  Objectives  (Bloom  et  si.,  1956). 

The  186  test  items  written  by  the  computer  specialists  were  reviewed, 
edited,  and  revised  by  the  principal  researcher.    The  entire  collection  of  items 
was  then  divided  into  two  sets,  each  containing  approximately  90  questions  re- 
lated to  the  competencies  plus  fourteen  items  involving  demographic  information. 
The  test  items  were  then  pilot  tested  to  collect  data  for  an  empirical  item 
analysis  so  that  revisions  oould  be  made  to  improve  the  content  validity  of  the 
items. 

The  two  sets  of  test  items  were  each  administered  to  two  criterion  groups 
as  recommended  by  Berk  (1980)i   sa  instructed  group  of  students  sad  an  unin- 
structed  group  of  students.    The  instructed  group  consisted  of  forty-four  subjects 1 
forty-one  college  students  enrolled  in  two  educational  computing  courses  sad 
three  computing  instructors  in  the  College  of  Education  at  Iowa  State  Univer- 
sity.  The  students  in  these  courses  were  considered  instructed  in  computer 
*  literacy  because  a  course  titled  Introduction  to  Computer  Applications  was  a 
prerequisite  to  saoh  course.   The  uninstruoted  group  consisted  of  thirty-five 

r 

students  in  eduoation  courses  who  had  not  taken  a  computer  literacy  course 
previously.    Students  in  these  courses  who  reported  that  they  had  tsken  a 
computer  oourss  were  not  included  la  the  data  analysis. 
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The  data  Iron  ssoh  set  of  Items f  each  section  of  the  tsst,  end  each 
criterion  group  were  analysed  by  obtaining  tho  following  statistics! 
■sans,  nriiaeti,  standard  deviations,  iten  difficulty  indieee,  item  discrim- 
ination indices,  mod  tho  frscuanoiss  of  students'  responding  to  oooh  distraotor 
oa  oooh  itoa.   These  statistics  wars  carefully  analysed  to  identify  itens  that 
needed  to  be  revised  or  dieoarded  to  improve  tho  oontont  validity  of  tho  test. 

Jb  addition  to  tho  empirical  itoa  analysis,  a  Judgmental  itoa  analysis 
was  eonduotod  by  a  panel  of  nine  eoaputsr  spscialiate  at  Iowa  Stats  Tkiivsrsity. 
Tbs  eoaputsr  speelsllsts  were  asked  to  examine  each  itoa  and  its  respective 
competencies  and  make  a  Judgment  about  tho  item-competency  congruence  and  the 
technical  quality  of  each  item,   a  rating  scale  like  one  proposed  by  Hovinelli 
and  Hambleton  (1976)  was  used  to  rate  how  well  each  item  measured  the  compe- 
tency it  was  intended  to  measure  (l-poorf  2-fair,  >average,  It-good,  5-excel- 
lent).   The  mean  ratings  for  all  of  the  Judgee  were  calculated  as  an  indica- 
tion of  the  degree  of  item-competency  congruence  for  each  item.    The  higher  the 
number,  the  more  congruent  the  item-oompetency  match.    The  Judges  were  alao 
asked  to  rate  the  technical  quality  of  the  item,  by  indicating  whether  they 
felt  the  item  should  be  rejected  (O,  accepted  with  revisions  (2),  or  accepted 
as  it  was  (3).  . 

» 

Berk's  (1980)  guidelines  for  the  selection  of  items  for  a  criterion- 
referenced  instrument  were  considered  in  the  decision  to  retain,  revise,  or 
reject  each  item.   The  criteria  for  acceptable  items  are  summarised  in  the 
following  manner  1 

Item  nhamcterlat^c     Criterion  l£&2&ZS2m 

Item-comp«teney  Matches  objective  measured  mean  rating  (3.00-5.00) 

congruence 

# 

Difficulty  Difficult  for  uninstructed  0^50  (uninstructed) 

group.   Sosy  for  instructed 

Sono.  50-100  (instructed) 
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ohirmcterHtlO  £O^Eiflfi 

Discrimination  Inacriminatee  between  positive  iiidexJlCMOO) 

(MS  .  .)  instructed  and  uninstructed 

•MS*  criterion  groups 

Discrimination  Discriminates  within  each  positive  index  (.10-1.00) 

(ltwicow  criterion  group 

correlation) 

A.  a  remit  of  the  empirical  end  judgmental  item  analyses,  a  total  of 
sighty  items  were  eeleeted  for  the  three  sections  of  the  STCLi  twenty-four 
for  computer  systsas,  twenty-eight  for  ceaputer  smplicationa, .snd  twenty-three 
for  ooaputer  programing.   To  ensure  that  the  items  included  in  the  final  test 
were  representative  of  the  domain  of  ooaputer  literacy,  items  were  selected  so 
that  each  competency  was  measured  by  the  test.    As  the  test  items  were  being 
analysed,  it  became  apparent  that  some  of  the  competencies  needed  to  be  revised 
to  more  accurately  reflect  the  actual  competencies  measured  by  the  test.  Compe- 
tencies that  expressed  the  same  basic  skills  v      cabined  into  one  competency, 
snd  competencies  that  expressed  acre  then  one  skill  were  separated  into  discrete 
competencies.    The  final  list  of  ooaputer  literacy  competencies  contained  eighty 
competencies!    twenty-five  in  computer  systems,  twenty-five  in  computer  applica- 
tions, twenty-one  in  computer  programming,  and  nine  in  computer  attitudes. 

The  completed  version  of  the  STCL  was  divided  into  five  eections i  Back- 
ground Information,  Computer  Attitudes  (CAIS  snd  BACS),  Computer  Systems, 
Computer  Applications,  snd  Computer  Programming.    The  instrument  was  designed 
so  that  it  could  be  administered  as  a  whole  or  by  section. 

The  STCL  was  administered  to  two  groups  of  subjects,  instructed  snd  un- 
instructed  students,  in  order  to  determine  performance  standards,  demonstrate 
the  test's  validity  and  reliability,  and  to  determine  normative  data.   The  CAIN 
wa.  not  administered  at  this  time  because  validity,  reliability,  snd  normativs 
data  had  been  collected  by  Usurer  in  1983. 

4 
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Th,  instructed  group  of  subjecte  consisted  of  152  college  student*  who  bad 
received  instruction  coneietent  with  the  computsr  literacy  oompetenoiee  in  a  - 
course  titled  Introduction  to  Computer  Application..   The  uninstrueted  group  of 
■abject*  consisted  of  110  college  students  vhc  h&d  not  taken  a  computer  esurss 
based  on  the  computer  literacy  cWpetencies. 

Following  the  administration  of  the  test  to  th*  two  criterion  groups, 
performance  standards,  or  cut-off  scores,  for  the  total  STCL  and  each  of  its 
subtests  were  determined  by  the  method  proposed  by  Berk  (1976).    This  msthod, 
whichis  similar  to  ths  Contrasting-Groups  method  (Hsmbleton,  1980),  involved  the 
idem  f ication  of  the  point  of  intersection  of  the  frequency  distribution  curves 
for  the  uninstrueted  and  instructed  groups. 

The  test  score  corresponding  to  ths  point  of  intersection  for  each  section 
of  the  test  was  then  evaluated  by  the  principal  researcher  land  the  steering  commit- 
tee to  determine  whether  it  was  a  reasonable  and  appropriate  criterion  for  classi- 
fying students  as  masters  and  nonmasters  of  computer  literacy.    If  the  performance 
standard  identified  with  this  method  was  not  considered  appropriate,  a  standard. 

> 

was  set  based  on-the  judgment  of  the  steering  committee. 

Internal  consistency  reliability  coefficients  for  the  total  STCL,  each  sec- 
tion, and  each  criterion  group  were  estimated  using  the  Kuder-Eichardson  20  reli- 
ability formula  (Ebel,  1972).    Internal  consistency  reliability  for  the  BAGS  was 
estimated  with  coefficient  alpha  (Cronbach,  1970).    Since  the  instrument  has 
characteristics  of  both  norm-referenced  and  criterion-referenced  tests,  a  reliability 
of  greater  than  0.70  was  considered  an  acceptable  reliability  coefficient  (Iowa  ~ 
^     State  university  Test  and  Evaluation  Services,  1983)* 

Construct  validity  for  the  total  STCL  and  each  of  its  sections  was  deter-' 
mined  by  calculating  the  amount  of  difference  between  the  mean  score  of  the  in- 
structed and  the  uninstrueted  groups.    The  means  for  the  instructed  group  should 

$ 
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be  significantly  higher  than  the  mesne  for  tbs  unistrueted  group.   A  statisti- 
cally significant  (p  0.05)  diffsrsnoe  between  tbs  two  means  vaa  eonaidarad  neee- 

G 

ssary  to  daaonatrata  that  the  dlffarasoa  in  tha  means  did  not  occur  by  ohance. 
A  T-test  vaa  uaad  to  determine  if  tha  diff aranoaa  between  too  aaana  of  tha  two 
groups  vara  significant  at  tha  0.50  level  (Kaaon  and  Bramble,  1987). 

Decision  validity  for  -tha  entire  STCL  and  each  eeotiom-waa  determined  by 
summing  the  percentage  of  unins  tracts'  students  who  were  elsaaif  ied  aa  nonmaetere 
of  ocoputer  literacy  and  the  percentage  of  instructed  studente  who  were  classified 
aa  masters  of  ocoputer  literacy.    Studente  who  scored  shore  the  cut-off  score  were 
classified  as  masters  of  the  content ,  and  students  who  scored  below  the  cut-off  ' 
•core  were  classified  aa  nonmaetere  cf  the  content.    She  number  of  instructed 
students  classified  aa  masters  snd  the  number  of  unins trusted  students  classified 
aa  nonmastsrs  should  be  high  to  demonstrate  that  the  decisions  made  baaed  on  the  • 
teet  scores  are  valid  decisions.    In  other  words,  the.  higher  the  total  percentage 
of  students  who  performed  on  the  teat  aa  they  were  expected  to  perform,  the  more 
decision  validity  the  test  contained  (Bambleton,  1980). 

Bormative  data  for  the  two  criterion  groups,  unins true ted  and  instructed 
college  students,  were  collected  for  the  entire  STCL  and  each  section  of  the  test. 
The  mean  score,  standard  deviation,  range,  frequency  distribution  curves,  and 
percentile  scores  were  reported  for  the  total  STCL  and -each  of  its  sections. 

The  final  step  in  the  development  of  the  STCL  waa  the  preparation  of  a  com-  > 
plete  STCL  package  that  waa  sponsored  by  the  Iowa  State  university  feeeareh 

Foundation  (ISUH?)  for  publication.    The  components  Of  the  complete  STCL  package 

S 

are*Hbe  following;!    the  Achievement  Teet  containing  80  multiple  choice  teat  items 
divided  into  three  sections,  Computer  Systems,  Computer  Applications,  and  Computer 
Programming;    the  Computer  Anxiety  Index  containing  26  items ;   and  the  Test  Admini- 
strator's Manual  containing  the  definition  of  computer  literacy,  the  competency 
list,  the  normative  group  tables,  the  administration  instructions,  and  tha  Computer 
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Literacy  Bibliography.   Tht  complete  STCL  package  or  say  of  its  components  may 
bo  purchased  through  tfao  College  of  Iduoation  at  Iowa  State  University.  Scoring 
of  the  8TCL  may  bo  accomplished  at  Iowa  Stato  University's  Tsst  and  Evaluation 
Servioe.    Individual  and  group  aeom  f  and  it«m  analyses  ass  provided  for  the 


i 

  r 

STCL  and  it  a  subtests. 
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Rosulta 

The  means,  standard  deviations v  and  ranges  for  the  STCL  and  its  sections  for 
eaoh  oriterion  group  are  reported  in  Table  1  •   The  mean  score*  for  the  instructed 
group  were  higher  than  the  mean  scores  for  the  unina  true  ted  group  by  one  to  two 
standard  deviations  for  all  sections  of  the  test  except  the  B4CS  (Ellsworth  and 
Bowman,  1982);   The  mean  scores  for  the  BACS  suggested  that  both  instructed  and^ 
uninstructed  subjects  had  mors  positive  attitudes  about  computers  than  negative7 
attitudes  since  lower  scores  indicated  positive  attitudes  toward  computers.  On 
a  sosio  of  1-6,  with  1  being  the  most  positive,  the  mean  scores  eoverted  to  aver- 
age  ratings  ware  2.27  for  the  instructed  group  and  2.50  for  the  uninstructed 
group. 

The  percentile  scores  and  corresponding  raw  scores  for  the  total  STCL  and  its 
subtests  for  each  criterion  group  are  presented  in  Tables  2  and  3-    These  tables 
cab  be  used  to.  compare  students'  scores  on  subsequent  testings  of  the  STCL  with 
siailsr  or  differing  norm  groups.    The  change  in  percentile  scores  for  similar 
norm  groups  over  many  subsequent  testings  could  bo  used  to  substantiate  that  etu- 
dents  in  a  particular  group,  as  a  whole,  are  beeom&g  mors  or  lsss  computer  litsr- 
ate.   The  percentile  scores  of  students  could  be  used  as  guide  for  placing  stu- 
dents in  instructional  treatments  baaed  on  whether  they  seers  above  or  below  a 

specified  percentile* 

Th»  frequency  distributions  of  van  aoor*.  for  tbs  total  met  ml  web  »uo- 
twt  for  both  orittrion  groups  sx»  shovn  is  tigsm  1  through  $.   She  iittwrmfra 
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in  ths  frequency  distributions  bstvasn  ths^two  eritsrion  groups  can  be  more 
easily  seen  snd  svaluated  if  the  two  distributions  srs  shown  on  ths  sons  graph. 
Ths  points^of  intsrssotion  of  ths  two  distribution  curvet  for  sseh  section  of  ths 
tsst  wsrs  identified  ss  ths  cut-off  scores,  for  olassifyin*  itudsnts  as  masters 
^sjd  nonmaaters  of  ths  content  nessured  by  sseh  section  of  the  instrument*  Ths 
resulting  cut-off  scores  are  reported  in  Table  U. 

me  steering  committee  evaluated  the  cut-off  scores  established  with  this 
sethod  and  concluded  that  ths  out-off  scores  were  not  appropriate  standards  for 
classifying  students  as  nsstsrs  and  nonasstsrs  of  computer  literacy, 
ing  oosnittee  f sit  that  conputsr  literate  individuals  should  be  abls/to  snswsr 
more  of  the  items  correctly  than  ths  cut-off  scores  suggested.    The/mean  score 
for  the  instructed  group  in  each  seotion  was  considered  a  more  appropriate  cut- 
off score  for  each  seotion  of  the  test.    The  cut-off  scores  recommenced  by  the 
steering  committee  are  reported  in  Table  5» 

y  item  statistics  for  each  STCL  test  item  were  collected  for  both  criterion 
groups  snd  are  reported  in  Table  6.    The  Difficulty  Indices  were  determined  by 
cosputing  the  percentage  of  students  in  each  group  who  answered  ths  item  oor- 
reotly.    A  range  of  0  to  100  was  possible,  with  100  indicating  the  lowest  level 
of  difficulty.  Two  different  Discrimination  Indices  were  computed  for  each  item. 

The  first  Discrimination  Index  computed  was  the  correlation  between  the  item 
soore  snd  ths  total  tsst  score,   a  range  of  -1.00  to  +1.00  waa  possible  with  +1.00 
indicating  the  highest  level  of  discrimination  between  the  ■tudents  within  each 
group.    The  Second  Discrimination  Index  was  the  XJninstruoted-Jnstructed  Croup 
Difference  Discrimination  Index  (DIS^}  (Berk,  1*80).    It  was  computed  by 
subtracting  ths  Difficulty  Index  for  the  uninstructed  group  from  the  Difficulty 
Index  for  the  instructed  group,  yielding  an  index  of  -100  to  +100.   The  higher 
the  index,  the  more  the  item  discriminated  between  students  in  ths  instructed 
group  and  students  in  the  uninstruoted  group. 
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Alio  included  in  Table  6  An  the  competencies  measured  by  saoh  item,  the 
item-competency  congruence  rating  from  the  judgmental  analysie,  and  the  number 
of  eubjeote  who  omitted  eeoh  item*   An  1 tea-competency  rating  was  net  reported 
for  items  that  were  written  following  the  judgmental  analysis.   However,  they 
were  written  based  on  the  suggestions  of  the  computer  spoeialists  and  were  thus 

■ 

ooneidered  to  be  congruent  with  the  competencies. 

The  STCL  as  a  whole  was  shown  to  be  very  reliable,  as  reported  in'  fable  7. 
The  internal  consistency  reliebility  estimates  were  0.66  for  the  instructed  group 
and  0*91  for  the  unlnetruoted  group*    The  internal  eonrdstenoy  reliebility  eetL- 
mates  for  the  individual  subtests  were  eomewhat  lower,  but  still  indicated  that 
the  subtests  were  reliable  for  at  least  one. of  the  'Criterion  groups. 

Content  validity  for  the  teat  items  was  established  during  the  development 
of  the  instrument.    The  use  of  computer  specialists  to  identify  competencies  that 
were  representative  of  the  domain  of  content ,  the  writing  of  test  items  matched 
to  the  competencies,  and  the  item  and  judgmental  analyses  all  contributed  poei- 
tively  to  the  content  validity  of  the  test. 

Construct  validity  was  demonstrated  for  the  total  STCL  and  its  subteete  by 
calculating  the  differences  between  the  mean  scores  of  the  instructed  and  unln- 
etruoted ^groups  and  showing  that  the  differences  were  statistically  significant. 
The  actual  differences  between  the  two  criterion  groups  revealed  that  the  mean  of 

•  -  « 

the  instructed  group  was  at  least  one  standard  deviation  above  the  mean  of  the 
uninstructed  group  for  every  soot ion  except  the  B4CS.    T- teste  were, calculated 
to  determine  whether  the  differences  were  significant.    The  results  of  the  $- 
teste,  reported  in  Table  3.  indicate  that  there  were  significant  differences  be- 
tween the  mean  scores  of  the  two  criterion  groups  for  the  total  STCL^and  each  of/ 
its  sections.    This  indicates  that  the  differences  did  not  occur  by  chance  and 
helps  to  establish  that  the  instrument  is  construct  valid. 
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The  STCL  sad  each  of  its  subtests  ware  shown  to  have  s  high  degree  of  deci- 
sion validity  because  a  high  percentage  of  the  students  scored  as  their  criterion 
group  indicated  they  should.    In  other  words,  the  higher  the  percentage  of  in- 
structed students  who  scored  above  the  established  cut-off  score  sad  the  higher 
the  percentage  of  uninstructed  students  who  scored  below  the  cut-off  score,  the 
higher  the  decision  validity  of  the  instrument.    The  established  cut-off  scores 
sad  corresponding  percentages  are  reported  in  Tables  U  and  5  for  each  of  the 
method*  used  for  establishing  the  cut-off  scores.    Both  methods  of  establishing 
the  cut-off  scores  yielded  percentages  of  appropriately  classified  subjects  that 
were  high  enough  to  indicate  a  high  degree  of  decision  validity. 

Possible  Uses  of  the  STCL 

There  are  several  possible  uses  for  the  STCu.    The  primary  goals  for  the  STCL 
were  to  asseas  the  computer  literacy  of  students  at  various  educational  levels, 
and  to  guide  the  development  of  appropriate  instruction  so  that  all  students  could 
become  computer  literate.    These  primary  goals  could  be  accomplished  by  using  the 
STCL  in  the  following  ways. 

Cut-off  sccres  could  be  established  in  order  to  identify  various  degrees  of 
oomputer  literacy.    Student  scores  could  be  compared  to  the a*' cut-off  scores,  and 
oould.then  be  used  as  one  of  the  criteria  for  assigning  students  to  courses  appro- 
priate to' their  degree  of  computer  literacy.   At^ut-off  score  could  be  identified 
as  one  of  the  criteria  necessary  for  students  to  test  out  of  a  particular  courss 
or  segment  of  a  course.    For  example,  a  student-    ,-o  scored  above  the  cut-off  scores 
on  the  Computer  5yst.ee*  and  the  Computer  Applications  sections  of  the  STCL,  but 
below  the  cut-off  *r..ri  on  the  Computer  Programming  oeotion  could  be  placed  in  a 

course  dealing  strictly  with  computer  programming. 

/ 
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The  STCL  cauld  be  used  to  identify  the  specific  computer  literacy  competencies 
poeeeeeed  end  not  possessed  by  individuals  in  a  particular  course  or  group.  The 
test  items  on  the  STCL  are  keyed  to  the  competencies,  So  an  examination  of  indi- 
vidual responses  to  each  item  could  provide  appropriate  diagnostic  information. 
Instruction  could  then  be  designed,  or  revised,  to  ensure  that  the  students  master 
the  competencies  that  were  lacking. 

The  STCL  could  be  used  to  idenfify  persons  who  are  highly  computer  anxious, 
anxiety  towards  computers  may  inhibit  the  subjects*  interaction  with  computers 
and  subsequently  influence  their  level  of  computer  literacy.    Persona  who  are  high- 
ly computer  anxious  may  benefit  from  treatments  designed  to  decrease  their  anxiety 
prior  to  receiving  instruction  about  the  cognitive  aspects  of  computer  literacy. 

The  STCL  could  be  administered  to  a  variety  of  norm  groups  for  the  collection 
of  more  comprehensive  norm  data.    The  normative  information  from  a  wide  variety 
of  groups  could  be  used  to  identify  groups  in  need  of  instruction.  Subsequent 
administrations  of  the  test  to  the  same  groups  following  instruction  could  provide 
valuable  information  about  the  quality  of  the  instruction  and  oould  influence  the 
revision  of  the  instruction. 

Summary  of  Results 

r 

1.  The  STCL  was  found  to  be  a  valid  measure  o£  computer  literacy. 

2.  The  STCL  was  found  to  be  a  reliable  measure  of  computer  literacy. 

3.  The  STCL  could  be  used  as  one  of  the  criteria  to  classify  students  as 
computer  literate  or  not  computer  literate. 

li*    The  STCL  could  be  used  to  facilitate  decisions  about  the  placement  of 
students  in  computer  literacy  courses,  _ 

$.    The  STCL  could  be  used  to  document  the  computer  literacy  competencies  of 
students,  and  oould  be  used  in  identifying  instructional  needs  and  goals. 

6.    The  STCL  could  be  used  as  a  basis  for  the  design  and/or  revision  of 
appropriate  computer  literacy  instructional  programs. 
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Section  XI*  Section  III 
Attitudes  System* 


SICL  and  subtests  by 


Mean  score 
Instructed0 
Dninstructed* 

Standard  deviation 
Instructed 
Oninstructed 

Actual  range 
Instructed 
Oninstructed 

Possible  range 


38.70 
42.50 

9.49 

8.19 

25-64 
23-62 
17-102 


18.62 
11.70 

3.83 
5.11 

a-27 

0-25 
0-29 


17.50 
10.82 

4.31 
5.10 

0-26 
0-23 
•0-28 


11.09 
5.72 

3.79 
4.59 

0-20 
0-19 
0-23 


47.20 
28.24 

10.18 
13.15 

13-69 
2-63 
0-80 


*Votal  score  for  Sections  in,  XV,  and  V  combined . 

CH«152. 

S-110. 
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Table  4.   Cut-off  mm  (Mr*.  1976)  for  total  m  and  subtests  and  percentages 
of  critjrioa  groupe  ataaaif iad  aa  neat era  and  nonasstere  of  tha  content 


Section 
ef  taat 

Cut-off* 
acora 

Percentage  of  criterion  groups 
classif  iad  aa  aaatara  and  ami 

appropriately 
latara  of  tha  contact 

Gtelnst  rooted^ 
0*110) 

e  *d 
Instructed              Both  groups 

fff-152)  19-262) 

XXX.    fystsms  . 

14 

M 

•9 

•1 

xv.  Applications 

IS 

70 

•t 

11 

V*    Prolyl  i  i  i  ig 

• 

M 

95 

7t 

Total  ta*t 

37 

7i 

•4 

a 

11 

*Cot-off  wee  determined  by  tha  point  of  intersection  between  tha  frequency 
distribution*  curves  for  tha  unina  true  ted  and  iaatraetad  critarioa  groups  (Berk, 
1976) . 

bPerrent«ge  of  un ins true ted  group  v|o  acorad  below  tha  cat-off  acora. 

cPareaataga  of  iaatraetad  group  ate  acorad  abgva  tha  cat-off  acora. 

percentage  of  both  groups  who  acorad  above  or  below  tha  cat-off  acora  aa 
thair  criterion  group  indieatad  they  should. 


Tabla  5.    Cat-off  acoraa  aat  by  ataarlng  cooed  tie*  for  total  and  subtests  and 

£rwnL£es  of  criterion  groups  cUasifiad  as  masters  and  aonmtars  of 
tha  coatant 


aaction 
of  tast 


Cut-off* 
acora 


Percentage  of  criterion  group  appropriately 
classified  aa  Masters  and  ironmasters  of  the  content 


Uninstructed 

H-iio) 


Instructed 
IP>1S2) 


Both  groups 
(S-262) 


XXX.    System*  19 

XV.    Applications  It 

v.    Programing  II 

Total  taat  47 


90 
90 
•5 
92 


91 
51 
51 
54 


67 
67 
67 
70 


•cut-off  was  determined  by  the  judgments  of  the  steering  cossmittee  to  be  tha 
aean  score  for  the  instruct^ group. 

*Vercent*ga  of  uninstructed  grow  ■*»  aeowd  below  tha  cat-off  acora. 

"percentage  of  iaatraetad  group  who  acorad  above  tha  cat-off  acora. 

Sereentaga  of  both  croups  who  scored  above  or  balow  tha  cat-off  score  as 
their  criterion  group  indicated  they  should. 
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tMt-itM  utlftii  lata  fro* 


tMtnet** 


%mm  cm**  I-C*  Mti6  Biff*  BU?  CMlta  Biff 


1 
3 
S 
4 
S 
i 
7 

9 

10 
11 
12 
II 
14 
19 
If 
17 
It 
19 
19 
31 
22 
31 
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<j 

29 

39 

>  17 
29 
29 
39 
31 
93 
23 
24 

99 
29 
37 
29 
29 


•1  4.9 
•2  4.2 
•3  4.9 
94  4.2 
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09  4.2 
94  4.9 
97  tf.4 
99 

•9  3.9 
•9  4.2 
910  9.7 
SIX  4.7 

912  4.4 

913  - 

914  - 
919  4.2 
114  4.4 

*t!9  4.4 
917  4.4 
917  4.9 
919  2.0 
929  4.9 
929  - 
921  - 
929  - 

921  ~ 

922  4.9 

923  2.4 

924  - 
923  4.9 
Al  2.0 
A3 

A3 

A4  4.9 
<  AS  3.9 
M  4.9 
A7  «.3 
M  4.9 
A4  3.9 
A3  4.9 
A10  4.3 
All  - 
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Table  7.    Reliability  titlMtn  for  total  9KL  and  subtests  by  critsrion  group 


Criterion  f  roup 

Section  XI* 
Attitudes 

Section  III 
Systems 

Section  IV 
Application* 

Section  V 
Programming 

Totalb 
test 

Instructed 
Uninstructed 

0.81c 
0.73 

0.64d 
0.78 

0.75 
0.80 

0.69 
0.81 

0.86 
0.91 

•part  One,  the  Beliefs  About  Computers  Scale  (Ellmorth  snd  Boeman,  1982) . 
Sections  III,  IV,  and  V  combined . 
Coefficient  alpha. 

^uder-Richerdson  20  reliability  coefficient  '(Sections  III,  IV,  V,  end  total) 


Table  8.    Comparison  of  SKL  test  scores  of  instructed  versus 
uninstructed  criterion  groups 

 _  ' 

'    2-Tailed ' 
Number    Mean    S.D.  T- Value  Probability 

  «p<.001>  


Section  II 

Instructed  152  38.7  9.5       3.38  0.001 

Uninstructed  110  42.5  8.2 

Section  III  » 

instructed  152  18.6  3.8    -11.92  0.0C1** 

Cninstructed  110  11.7  5.1 
Section  IV 

instructed  152  17.4  4.4    -11.23       *  0.001** 

Uninstructed  110  10.8  5.1 
Section  V 

instructed  152  11.2  3.8    -10.16  0.001** 

Uninstructed  110  5.7  4.6 


Total  test 
Instructed 


152      47.2  10.2    -12.58  0.001** 


i  uninstructed     110     28.2  13.2 


i  - 
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ABSTRACT 


This  study  investigated  the  effects  of  integrated  CBI  practice  on 
criterion  taste  performance  and  attidudes  of  learners.  Twenty  two 
subjects  participated  in  the  study,  11  in  a  treatment  group  and  11  in 
a  control  group.  All  subjects  too*  a  CBI  lesson  that  taught  them  to 
use  a  communications  software  package  to  transfer  files  between  a 
personal  computer  and  a  VAX.  The  lesson  taken  by  subjects  in  the 
treatment  group  included  an  additional  section  that  allowed  the*  to 
practice  the  task  without  Initial  instructional  prompts.  Then  each- 
subject  used  the  software  packeae  to  do  the  file  transfer  task. 
Subjects  who  took  an  additional  practice  section  completed  the  file 
transfer  in,  on  average,  half  as  long  as  the  subjects  who  did  not  have 
the  practice  section  (p  <  .001).  They  also  made  fewer  errors  (p  < 
.01).  There  was  only  a  slight  difference  between  control  and 
treatment  groups  on  total  attitude  score.  However  subjects  in  the 
control  group  were  much  more  likely  to  indicate  a  desire  for 
additional  review  than  subjects  from  the  treatment  group. 
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EFFECT  Of  INTEGRATED  CBI  PRACTICE 
ON  TASK  /PFPfcORMANCE  AND  ATTITUDE 


paae  2 


PURPOSE  OF  THE  STUDY 


Computer-based  instruction  (CBI)  courses  are  often  designed  to 
teach  the  computer  user  how  to  perform  a  series  of  steps  that  result 
in  the  oerformance  of  a  target  task,  such  as  transfering  of  a  fUjf 
between  two  computers,  or  creating  and  editing  a  letter.  Comnron 
sense,  informed  by  precepts  of  instructional  design  CBrlggs,  1977; 
Die*  and  Carey,  1974?  Gagne  and  Briogs,  1979),  and  instructional 
effectiveness  research  findings  (Hull,  1952;  Bugeshi,  1964;  Mowrer, 
1960),  would  dictate  that  -a^course  which  allows  the  user  to  practice 
the  entire  sequence  of  steps  that  comprise  a  task,  chained  toqether, 
would  be  more  'effective  in  teaching  the  target  task  than  a  course 
which  merely  allows  users  to  practice  each  step  in  Isolation. 
Research  findings  (Tobias,  1973;  Bloom,  1974;  Berliner,  1979; 
Rosenshine,  1979)  further  suggest  that,  generally,  any  instructional 
method  or  procedure  which  results  In  students  spendinq  more  time 
actively  engaged  In  the  learning  of  a  task  -results  In  higher 
achievement. 

However,  many  courses  simply  present  concepts  and  tell  the 
learner  about  the  steps  they  will  perform  to  accomplish  a  specific 
Cask  or  tasks.  At  best,  the  course  may  allow  the  learner  to.  practice 
each  step  in  isolation.  This  type  of  course  design  probably  has  not 
evolved  from  any  firmly  held  convictions  about  its  instructional 
effectiveness.  Rather,  it  is  more  likely  the  result  of  real  cost  and 
time  constraints  that  inevitably  impact  CBI  course  -desion.  At  some 
point  decisions  are  made,  perhaps  by  default,  that  the  additional  time 
renuired  to  include  practice  exercises  that  more  closely  approximate 
the  tasks  learners  must  ultimately  perform  outweioh  the  possible 
benefits  that  miaht  accrue  from  such  practice. 

Costs  associated  with  the  development  of  a  CBI  lessons  with 
integrated  practice  include  the  time  necessary  to  plan  and  implement 
the  practice  exercise.  Balanced  against  these  costs  are  the  possible 
benefits  which  miaht  result  from  users  performing  the  target  tasks 
more  quickly  and  with  fewer  errors  as  a  result  of  the  additional 
practice.  If  users  do,  in  fact,  use  the  target  software  with  more 
ease  and  rrecision  they  may  feel  more  less  frustrated  and  more 
confident  about  their  newly  acquired  skills. 

Tt  was  the  purpose  of  this  study  to  assess  the  benefits 
/  associated  with  CBI  course  designs  that  include  practice  sessions  that 
realistically  simulate  the  task  to  be  learned  as  well  as  the 
presentation  of  concepts  and  practice  of  individual  steps.  It  is  not 
possible,  within  the  confines  of  this  study,  to  determine  whether  the 
costs  outweight  the  benefits,  or  vice  yersa.  It  was  merely  our 
nurpose  to  conduct  a  comparative  study  of  CBI  instruction  that  did  and 
did  not  include  integrated  practice  . and  to  present  our  findings. 
These  findinas  represent  one  source  of  data  that  instructional 
desiqners  may  consult  to  inform  their  decisions  about  course  content 
and  structure. 
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EFFECT  OF  INTEGRATED  CBI  PRACTICE  Page  3 

ON  Vask  PERFORMANCE  AND  ATTITUDE 


DESIGN  OF  THE  STUDY 

Subject* 

In  this  study,  22  subjects  were  randomly  assigned  to  either  a 
treatment  or  a  control  group.  Subject  included  16  Boston  College 
undergraduate  and  qraduate  students,  all  of  whom  had  taken  at  least 
one  computer  course,  and  6  professional  Instructional  designers  of 
computer-based  instruction. 


A  research  assistant  explained  to  each  subject  that  the  purpose 
of  the  study  was  to  help  assess  the  effectiveness  of  different  types 
of  course  design.  Then  the  assistant  briefly  explained  the  personal 
computer  and  the  communications  software  package  that  was  the  subject 
of  the  CBI  course  used  as  a  treatment  in  the  study. 

Each  subject  took  two  CBI  lessons  that  were  taken  from  a  larger 
course.  The  first  lesson. was  an  Introductory  lesson  designed  to  teach 
computer  communications  concepts.  This  first  lesson  did  not  vary  for 
treatment  and  control  groups.  The  second  lesson  taught  how  to 
transfer  a  file  using  the  communications  software.  The  format  and 
content  of  this  second  lesson  was  varied  to  reflect  the  major  question 
addressed  by  this  study.  * 

For  the  control  group,  this  lesson  Included  an  Introduction  to 
file  transfer,  an  explanation  of  each  step  of  the  Tile  transfer 
process' accompanied  by  the  opportunity  for  the  learner  to  practice 
each  step,  and  a  summary.  The  lesson  taken  by  the  treatment  group 
Included  an  additional  section  that  was  Inserted  before  the  summary. 
This  section  was  designed  to  enable  learners  to  practice  doing  all  of 
the  steps  being  taught  in  the  task  sequence  without  interruption  and 
without  proirptinq.  This  section  of  the  lessen  was  designed  to  reflect 
what  a  user  would  do  when  working  with  the  communications  software, 
i.e.  enter  a  series  of  commands  to  perform  a  given  task  with  no 
explicit  prompting  from  the  system.  •  Subject  in  the  treatment  group 
were  given  prompts  only  when  they  answered  incorrectly  after  two 
tries.  After  an  incorrect  first  entry,  subjects  were  asked  to  try" 
again.  After  the  second  try,  they  were  given  an  Informational  hint. 
Finally,  sfter  the  third  incorrect  response,  they  were  given  vthe 
correct  response. 

Because  of  the  additional  Instruction  taken  by  subjects  in  the 
treatment  group,  it  took  them  longer,  on  the  average*  to  complete  the 
CBI  instruction.  The  average  time  required  for  control  group  subjects 
to  complete  the  two  CBI  lessons  was  17  minutes  while  the  average  time 
for  subjects  in  the  treatment  group  was  21  minutes. 

» 

Subjects  in  bgth  groups  were  permitted  to  take  notes,  if  they 
wished,  and  were  told  in  advance  that  after  the  lessons  they  would  use 
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the  sofware  about  which  they  were  learning*      Both    groups    were  also 
told  that  they  could  repeat  any  part  of  the  lesson  they  wis-hed. 

When  each  subject  had  finished  talcing  the  CBI,  s/he  was  assisted 
by    a    second    research  assistant  who  did  not  know  whether  the  subject 

had  been  assigned_to^  the_ treat .me nt  ^r    control  group.     The  research 

assistant,  reading  from  a  prepared  text,  explained  the  task  that  the 
subject  was  to  perform.  The  task  Involved  actually  performing  a  file 
transfer  using  a  personal  computer  connected*  by  a  modem  to  a  VAX 
computer. 

Subjects  were  observed  while  performing  the  task  by  the  second 
research  assistant.  Subjects*  comments  and  actions,  as  well  as 
correct  and  Incorrect  responses  were  recorded  on  an  observation 
protocol.  A  task  performance  score  was  computed  for  each  subject 
based  on  responses.  The  total -number  of  minutes  regulred  to  perform 
the  task,  rounded  to  the  nearest  minute,  was  a ITm^ recorded.  After 
task  was  completed,  an  attitude  guestionnaire  Has  administered  to  each 
subject.  The  guestionnaire  was  designed  to  assess  each  subject's  . 
opinion  of  how  adeguately  they  felt  the  instruction  had  prepared  them 
to  do  the  file  transfer  task.  Students  rated  themselves  on  a  scale 
from  strongly  agree  (6)  to  strongly  disagree  CI)  on  each  item. 


RESULTS 


•  - 

'EFFECT  OF  INTEGRATED  CBI  PRACTICE 
ON  TASK  PERFORMANCE  AND  ATTITUDE 


Subjects  in  the  treatment  group,  on  average,  performed  better  on 
the  criterion  task  than  did  subjects  In  the  control  qroup  (see  Table 
1).  Out  of  a  total  possible  of  27  points  tnat  could  be  derived  from 
the  task  performance  scoring  procedure,*  the  averaqe  scor~  for  the 
treatment  (practice)  group  was  24.91  with  a  standard  devi  i  ion  of 
2.21.  Hiqh  and  low  scores  were  27  and  21,  respectively.  The  average 
score  for  the  control  group  was  20.36  with  a  standard  deviation  of 
■4.23.  The  hiohest  score  for  the  control  group  was  25  and  the  lowest 
was  13.  As  these  dat^  Indicate,  there  was  much  less  variability  among  t 
"the  scores  of  subjects  in  the  treatment  group  as  compared  to  the 
scores  of  subjects  in  the  control  group.  The  results  of  statistical 
analysis  uslnq  a  one-tailed  t-test  to  assess  the  sionificance  of  the 
difference  between  mean  scores  of  the  two  groups  yielded  a  probability 
level  of  .01 
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Table  1 

Mean  Task  Performance  Scores 


TREATMENT 
N  s  11 


CONTROL 
N  8  11 


t*test 


24,91 
sd  m  2.21 


20.36 
Sd  «  4.23 


I     P  <  .01 


.The  most  Impressive  difference  between  treatment  and  control 
groups  was  Observed  when  average  tia',s  to  complete  the  criterion  task 
were  compared.  It  took  subjects  In  the  control  group  nearly  twice  as 
long,  on  average,  to  complete  the  target  task  as  It  took  subjects  In 
the  treatment  group.  As  can  be  seen  In -Table  2,  the  mean  for  the 
treatment  (practice)  group  was  4.81  minutes  while  the  mean  for  the 
control  group  was  8.90  minutes.  A  one-tailed  t-test  Indicated  a 
significance  level  of  .001.  As  can  be  discerned  from  the  standard 
deviations  reported  In  Table  2,  there  was  again  more  variability  among 
subjects  In  the  (control  group  than  among  subjects  In  the  treatment 
group.  The  fastest  subject  In  tfce  control  group  completed  the  task  In 
3  minutes  and  the  slowest  subject  In  that  group  took  B  minutes.  In 
contrast,  the  fastest  person  in  the  control  group  completed  the  task 
*      In  5  minutes,  while  the  slowest  regulred  14  minutes. 

Table  2 

>  -      Mean  Tlm#  to  Complete  Task 

TREATMENT  CONTROL  t-test 

N  s  11  N  =  11 

I  I  I 

*    I     4.82  mln.       I     8.91  mln.     I     p  <  .001 

I  I  I 

i     Sd  s  1.66       I     Sd  »  2.66  I 

I  t  *  I 


•»  Altitude  at  Subject* 

Responses  to  >e  attitude  measure  were  analyzed  for  each  Item  for 
the 'control  group  .«*td  treatment  group*  Items  were  categorized  as  High 
Aqreement  if  the  majority  of  students  rated  themselves  as  3  (agree)  or 
4  (strongly  agree),  pr  Low  Agreement  If  most  students  raced  themselves 
as  2  (disagree)  or  1  (strongly  disagree)  on  that  Item. 

The  results  are  presented  In  Teble  3.  The  ratings  for  the  groups 
differ  only  for  Item  3.    The  majority  of  control  group  subjects  agreed 

•v 
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effect  OF  INTEGRATED  CBI  PRACTICE  6 
ON  TASK  PERFORMANCE  AND  ATTITUDE  . 

whereas  a  majority  of  the  treatment  group  subjects  disagreed  with  the 
statement  that  tney  wished  they  coti id  have  reviewed. tha  lesson  again. 
Only  a  slight  difference  was  observed  between  the  control  and 
treatment  groups  overall  on  the  attitude'  measure.  _^  :  — . — — 


Table  3 

Summary  of  Results  of  Attitude  Self  Ratings 

scseecssssscassssBsesss^taassssescssctccassissiBSssszssBStEciSES 

AGREEMENT 


ITEM 

TREATMENT 

CONTROL 

I. 

I  felt  I  had  the  information  I  needed 
to  be  able  to  use  the  software  to 
transfer  a  file. 

HI 

HI 

2. 

I  felt  very  frustrated. 

LOW 

LOW 

3. 

I  wish  I  had  had  a  chance  to  review 
the  lesson  again. 

LOW 

HI 

4. 

I  felt  I  understood  how  to  use  the 
software  to  transfer  a  fllefc 

HI 

HI 

5. 

I  Just  didn't  know  what  to  do. 

LOW 

LOW 

DISCUSSION 

The  results  of  this  study  support  the  premise  that  learners  are 
more  likely  to  successfully  accomplish  a  target  task  that  Is  comprised 
of  many  individual  steps  when  they  have  had  a  chance  to  practice  the 
steps  in  sequence.  This  outcome,  while  not  surprising,  has 
Interesting  implications  for  the  design  of  computer-based  instruction. 

Social  psycholgists  have  long  argued  *  that  people  strive  for 
competence,  that-  sense  of  efficacy  that  comes  with  the  perception 
that's  one's  environment  Is  understandable  and  manageable,  (Smith, 
1968).  More  simply  put,  people  like  %o  succeed.  When  success  means 
entering  a  series  of  commands  that  may  have  no  contextual  meaning  to  a 
novice  computer  user,  as  one  Instructional  designer  put  it,  "people 
need  all  the  help  they  can  get." 

• 

The  subjects  in  the  treatment  group  had  the  opportunity  to 
practice  what  they  had  Just  been  taught  In  the  CBI  lesson  before 
demonstrating  their  mastery  of  the  lesson  by  performing  a  file 
transfer    task.    The  additional  help  provided  by  the  practice  exercise 

* 

s 
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In  the  experimental  treatment  wee  well,  received  by  subjects. 

They    indicated    that    the    practice      "made     them     feel  more 

comfortable*  wSXh — the — software^  -One — subjeet  -noted  that  while  she 

enjoyed  talcing  the  CBI,  it  wafa*t  until  the  practice  session  that  she 
felt  very  confident  to  per fornt^he  task.  Said  another  Boston  College 
subject  "It's  just  like  teaching  ...  it  helps  if  you  review  and 
{practice)  the  lesson-." 

# 

It  is  this  self-directed  practice  that  Is  often  missing  from 
computer-based  instruction.  It  is  interesting  that  while  subjects  in 
the  treatments  were  told  they  could  review  the  CBI  .  and  the  practice 
session  as  many  times  as  they  wished,  no  one  reviewed  the  CBI  lessons. 
Four  of  the  eight  Boston  College  students  who  took  the  practice 
session  reviewed  the  session  before  beginning  the  target  task.  It  is 
not  surprising  that  all  four  of  these  students  attained  a  perfect  task 
performance  score  of  27.  Their  average  task  completion  time  was  3j6 
minutes,  when  given  the  opportunity  to  practice  until  they  achieved 
mastery,  these  subjects  did  so.  , 

Some  users  of  computer-based  instruction  have  indicated  that  it 
is  a  big  shock  to  oo  from  the  supportive  environment  of  a  CBI  course 
to  the  actual  software  the  course  teaches  about.  The  applications 
software  may  provide  understandable  error  messages  when  the  user  makes 
a  syntax  error.  However  if  the  user  simply  forgets  the  correct 
seguence  of  commands  and  enters  an  inappropriate  command,  such  help  Is 
not  available. 

It  is  possible  that  a  practice  session  like  the  -one  Included  in 
this  study  could  help  bridge  the  gap  between  supportive  instructional 
courseware  and  the  hard  realities  of  the  applications  software.  The 
practice  session  Included  no  direct  instruction  and  only  offered  hints 
after  two  unsuccessful  tries.  Thus  the.  users  had  a  chance  to  try  to 
do  the  task  on  their  own,  but  they  were  not  permitted  to  fall 
Practice  is,  after  all,  what  most  of  us  do  after  we  have  been  taugAt 
something  that  Involves  the  memorization  of  a  seguentlal  task,  we 
practice  until  we  get  it  right.  It  is  probably  much  'more  satisfying 
for  the  learner  to  practice  in  an  instructional  setting  than  in  the 
work  environment  where  lack'  of  success  may  have  more  serious 
consequences. 


SUMMARY 


The  purpose  of  this  study  was  tc  assess  the  extent  to  which  a  CBI 
lesson  that  Includes  a  practice  session  is  more  effective  than  a  CBI 
lesson  that  does  not  include  such  a  practice  sessln.  Subjects  In  a 
control  group  took  a  CBI  lesson  designed*  to  teach  the  user  to  transfer 
a  file  between  a  personal  computer  and  a  VAX  computer  using  a 
communications  software  package.  The  control  group  lesson  Included  a 
section  explaining  the  file  transfer  and    a    simulation    of    the  file 
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transfer  process  "  during  which  the  user  practiced  each  steo  ©rTWe 
process  as  it  was  presented.  "The  subjects  In. the  treatment  group  too* 
the  same  lesson,  with  an  added  practice  section  which  allowed  them  to 
or act Ice  the  file  Transfer  proces  with  no  instruction  b.  prompts.  If 
the  subject  made  an  error,  feedback  was  provided. 


I  a 


-  At  the  end  of  the  treatment,  each  subject  performed  a  file 
transfer  us-ing  the  communications  Software  package.  Subjects  were, 
observed  and.  each  correct  and  incorrect  response  was  recorded,  a  task 
performance  score  was  computed,  and  the  time  required  to  do  the  task 
was  measured  for  each  subject.  An  attitude  survey  was  administered  to 
each  subject  to  assess  how  the  subject  felt  about  the  instruction  and 
their  ability  to  perform  the  file  transfer  process. 

There  were  statistically  significant  differences  between  control 
and  treatment  groups  both  on  task  performance  and  task  time.  The 
treatment  group  made  fewer  mistakes  perfjoftnlng  the  file  transfer  task 
than  the  contrdl  group,  and  were  able  to  accomplish  file  transfer  in, 
on  average,  half  the  time  that  the  control  group-  required.  Despite 
these  dif f erenes,  there  was  only  a  .  slight  difference  between  the 
attitude  survey  averages  of  the  control  and  treatment  groups. 

Although  the  findlnas  of  this  study  are  based  on  a  small  sample 
(22)  subjects,  the  finding  that "the  treatment  group  performed  the  file 
transfer  in  about  half  the  time  that  the  control  group  required  is 
notable.  This  study  suggests  that  the  Inclusion  of  well  designed 
practice  sessions  results  in  substantial  gains  in  user  performance  of 
the  objectives  the  course  is  desloned  to  teach. 
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Abstract 

Computer-based  instruction  (CBI)  is  composed  of  individual  frames 
viewed  one  at  a  time.    Compared  to  a  typical  textbook,  CBI 
restricts  the  adult  learner's  capacity  to  (1)  access  information 

Mfferent  parts  of  th«  lesson  and  f 2)  view  complex 
pre  sei  tat  ion  s.    Designers  of  CBI  must  compensate  for  these 

".  V  « 

limitations  by  making  a  concerted  effort  to  ^ynthesi^  or  tie 

together  content  parts,  resulting  in  a  coherent,  stable  cognitive 

♦ 

structure  in  the  learner's  mind*    Six  synthesizing  strategies  are 
discussed  and  illust        i.    Greater  attention  to  content  synthesis 
will  .result  in  more  meaningful  CBI  materials.    Research  on  CBI 
strategies  is  related  to  a  framework  for  a  science  of  instruction; 
potential  research  questions  are  discussed. 
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Tying  it  all  Together: 
Synthesizing  Strategies  for  Computer-based  Instruction 
The  purpose  of  this  paper  is  to  propose  some  instructional 
strategies  that  can  help  synthesize  content  presented  in  a 
computer-based  Instructional  (CBX)  lessen.    To  explain  why  content 
synthesis  is  needed,  and  provide  a  background  to  the  paper,  we 
will  first  review  some  basic  differences  between  CBI  and  hard-copy 
media  and  define  "content  structure. "    Following  a  description  of 
content  synthesis  .strategies,  we  relate  CBI  research  to  a  broader 
science  of  instruction. 


Constraints  of  the  Medium 
Amid  the  recent    excitement  generated  by  computers  In 
education  among  educators,  some  concerns  remain  regarding  the 
quality  of  CBI  learning  outcomes.    Most  CBI  systems  exhibit  two 
main  constraints: 

1.  Limited  information  display.    Most  CBI  programs  use  a  40 
or  30  column  by  24  row  display.    In  practice,  a  CBI  frame  is 
not  much  larger  than  the  teaching  machine  frames  used  in 
programed  instruction  twenty  years  ago  (Skinner,  1968; 
Msrkle,  1969).    Human  factors  research  has  shown  that  reading 
from  a  CRT  display  is  more  difficult  and  causes  more 
eyestrain  than  reading  frpm  hard-copy  materials  (Campbell,  et 
al.,  1981).    CBI  as  an  instructional  medium  is  not  suited  to 
dense  information  display. 

2.  Limited  frame  access.    Access  to  individual  frames  may  be 
accomplished  by  special  commands  (control  characters,  special 
functions,  etc.)  or  by  a  menu  selection.    In  either  case, 
because  of  the  complexity  of  the  logic  and  the  cost  of 
development,  direct  access  to  individual  frames  is  extremely 
rare  in  CBI.    CBI  becomes  less  valuable  as  a  reference  source 
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and,  to  the  degree  that  frame  access  is  an  important  learner 
strategy,  less  valuable  as  a  learning  device. 

Two  sain  problems  result  from  the  constraints  described  - 
above.    The  first  problem  is  related  to  the  lack  of  learner 
control  over  information  presented  (M.  D.  Merrill,  1973) . 
Materials  that  do  not  allow  adult  learners  some  control  over 
instructional  events  mist  carefully  monitor  and  assess  student 
learning  throughout  the  program;  In  short,  they  must  be  adaptive 
systems  (Atkinson,  1976).    Otherwise,  learning  is  likely  to  suffer 
in  efficiency  and,  to  some  degree,  effectiveness*  Although 
considerable  resources  have  been  devoted  to  intelligent 
computer-aided  instruction  or  ICAt  <Walker  &  Hensr  198*) $  the 
development  costs  of  sophisticated  adaptive  systems  presently  ~ 
inhibit  their  widespread  use. 

The  second  problem  has  more  -to  do  with  the  limited  display 
capacity  of  CB1  systems.    An  essential  step  in  CB1  design  is 
careful  analysis  of  the  content,  breaking  tasks  down  into  small 
chunks  that  can  be  taught  and  tested  using  a  frame -based  system. 
Unfortunately,  large  doses  of  small  chunks  can  lead  to  shallow, 
superficial  comprehension  of  the  overall  subject.    There  can  be  a 
lack  of  content  synthesis  (Reigeluth  &  Stein,  1983).    Concepts  are 
often  not  adequately  integrated  together;  learners  lack- an 
understanding  of  how  things  fit  together.    This  notion  of  how 
content  fits  together  is  referred  to  as  content  structure 
(Merrill,  Kowallis,  &  Wilson,  1981;  Wilson,  1985).    Failure  to 
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grasp  the  c  cm  tent  structure,  according  to  schema  theorists 
(Rumelhart  &  Or t coy,  1977;  M.  D.  Merrill,  Wilson,  &  Kelety,  1981), 
leads  to  rapid  forgetting  of  the  material*    Conversely,  as  content 
structure  is  better  learned,  learning  becomes  more  meaningful  and 
stable  (Relgeluth,  1983;  Ausubel,  1968)* 


What  can  be  done  to  enhance  meaningful  learning  in  a  CB1 
environment?    There  is,  of  course,  no  simple  fonaila  to  be 
followed.    In  this  paper  we  discuss  six  specific  instructional 
strategies  that  can  help  synthesize  different  parts  of  a  subject 
into  a  stable  cognitive  structure  within  the  learner's  mind. 

1.    Use  hard-copy  adjunct  aids  such  as  diagrams,  f  jgures,  and 
content  outlines.    Figure  1  portrays  a  tree  diagram  Intended  for 
adjunct  use  with  a  CBI  program.    The  tree  diagram  sura&arizes  the 
essential  concepts  taught  in  the  CBI  lesson. 


Hard-copy  support  materials  seem  to  be  neglected  In  many  CBI 
systems*    Hard-copy  materials  can  be  valuable  for  a  number  of 


*  Display  of  information  frequently  accessed  ifl  the  lesson 

*  Display  of  figures  too  complex  for  effective  CRT  display 

*  Reinforcement  of" CBI  content  using  another  media 

*  Take-home  materials  to  serve  as  reference  and  reminder  of 
lesson  contest. 
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Even  the  most  sophisticated  CBI  environment  would  do  veil  to 
make  use  of  hard-copy  reference  materials;  students  often 
appreciate  the  "Look  what  I  learned!"  ojuallty  of  a  handout  or 
booklet. 

The  paucity  of  hard-copy  support  materials  In  CBI  packages 
may  be  a  blessing  in  disguise  for  many  teachers.    Integrating  CBI 
into  an  existing  curriculum  is  a  critical  task  for  teachers 
(Salisbury,  1984).    The  preparation  of  simple  support  materials  is 
an  important  way  teachers  can  adapt  CBI  products  for  use  in  a 
preexisting  curriculum  plan.    This,  of  course,  requires  some 
effort,  but  the  value  of  adjunct  materials  helps  make  it 
worthwhile  (Wilson,  1984) . 

2.    Implement  learner  control  features  such  as  menus  and  HELP 
options.      Learner  control  strategies  include  any  design  features 
that  require  Input  from  the  user  regarding  instructional 
decisions.    Examples  Include  options  to  skip  a  problem,  receive 
help  on  a  problem,  backtrack  to  the  previous  frame,  or  move  to  a 
different  lesson*  Tennyson  &  But  trey  (1980)  have  shown  that 
students  can  make  Intelligent  decisions  about  Instruction, 
particularly  when  relevant  information  is  available  to  them. 

Learner  control  features  can  aid  content  synthesis* 
Structurally  central  content  can  be  made  available  on  HELP 
selections.    Allowing  "scanning"  by  skipping  .practice  problems  can 
help  a  learner  develop  a  preliminary  schema  to  subsume  the  topic. 
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Allowing  a  variety  of  sequences  through  the  lesson  can  make  it 
more  likely  that  the  learner* s  existing  cognitive  structure  Indeed 
matches  the  assumed  prerequisites  of  the  pre saltation. 

Allowing  for  learner  control  is  the  designer 9 s  way  of 
admitting  the  program  is  not  a  foolproof,  deterministic  solution 
to  every  user's  needs.    Rather  than  expecting  the  program  to 
provide  all  the  answers,  a  program  allowing  learner  control  places 
greater  responsibility  In  the  hands  of  the  learner  to  control  the 
learning  pace,  sequence,  and  direction.    Although  research  has 
clearly  shown  that  learner  control  is  not  the  cure-all  for  CBI 

0 

design  v  (Steinberg,  1977),  prudent  use  can  contribute  to  content 
synthesis. 

3 .    Uselgraphic  synthesizers  such  as  lesson  maps,  diagrams, 
and  other  fMires  to  periodically  orient  the  learner  toward  the 
content  stnyture.    The  same  figure  used  as  an  adjunct  aid  in 
Figure  1  wai  also  included  in  the  CBI  program  itself-    Note  the 
relative  simplicity  of  the  diagram;  more  complex  figures  and 
diagram,  while  possibly  providing  more  information,  become 
unsuitable  or  display  on  a  CRT  scree**. 

Other  kinds  of  diagrams  can  be  very  useful.  Simple 
flowcharts  can  portray  direction  and  sequence.    TICCIT  (Merrill, 
Schneider,  &  Fletcher,  1980)  used  course  maps  as  a  means  of 
orienting  learners  toward  the  structure  of  the  lessons. 

The  value  of  figures  and  pictures  in  hard-copy  instruction 
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has  been  demonstrated  In  research  and  practice  (Levle  &  Lentz, 
1982;  Alesandrlnl,  1984).    The  use  of  a  tree  diagram  representing 
the  content  structure  can  help  learners  acquire  a  hierarchy  of 
concepts  as  mil  as  improve  their  attitude  toward  the  lesson 
(Wilson  &  Merrill,  1980;  Wilcox,  Merrill,  &  Black,  1981).  Several 
researchers  have  offered  design  guidelines  to  maximize  the 
effectiveness  of  graphic  displays  (Brody,  1984;  Mac Donald-Ross, 
1978;  F.F.  Merrill  6  Bunder  son,  1981).    While  increasing  attention 
has  been  given  to  el ec tonic  display  design  (P.F.  Merrill,  1982; 
Alesandrlnl,  1984),  the  unique  problems  of  electronic  figures  and 
diagrams  are  still  not  well  understood.    The  information-display 
constraints  of  electronic  media  require  simple,  direct  f  igures 
that  can  be  easily  conveyed  on  the  screen.    This  may  account  for 

e 

the  seeming  absence  of  content-relevant  graphics  In  most  CBI 
products  available  today. 

4.    Use  animation^  graphics,  sound,  and  timing  to  highlight 
structurally  central  content  parts.    Any  instructional  message 
contains  more  Information  than  the  learner  can  be  expected  to 
encode  and  hive  available  for  recall.    Is  the  exact  wording  of  a 
paragraph  Important?    The  specifics  of  an  example  used?  The 
question  for  designers  is,  what  parts  of  the  presentation  do  we 
expect  the  learner  to  remember  and  use,  and  how  do  we  communicate 
that  Intent  to  the  learner,  thus  sharing  the  responsillity  for  the 
outcomes  of  Instruction?    One  way  we  can  "tip  off"  the  learner  to 
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these  intentions  is  by  presenting  stated  objectives:  "At  the 


important  way  learners  catch  on  to*  instructional  intentions  is  by 
observing  cues  such  as  highlighting f  headings*  and  paragraph 
structure.  (Anderson  &  Faust,  1974;  Duchastel,  1982).    These  cues 


should  support  and  not  detract  from  a  clear  exposition  of  the 
content  structure* 

The  cues  available  to  CBI  designers  are  numerous: 

a.  Graphics  and  animation.    Graphics  are  often  used  as  r 
"frills1* — entertaining  spots  unrelated  to  the  content  of  the 
lesson.    This  is  a  great  waste  of  potential.    Visual  displays 
can  c essoin icate  content  structure.    Animation,  usually  used 
for  cartoon  ami  semen  t9  can  be  intrinsic  to  the  subject  matter 
and  convey  critical  information  Ofelone,  1981K 

b.  Use  of  space.    The  screen  layout  and  balance  should  focus  on 
structurally  important  parts  of  the  message.    This  can  be 
done  by  careful  use  of  vhite  space. 


c.  Sound.    Sound  is  another  form  of  information,  often  used 
successfully  as  a  means  of  performance  feedback. 

d.  Timed  presentations*    The  temporal  order  of  the  display  can 
be  a  surprisingly  effective  means  of  cuing  learners  to 
important  content  elements.    Graphic  overlays  and  timed 
display  of  text  can  draw  the  learner's  attention  to 
appropriate  detail  while  the  basic  frame  remains  the  same. 
Properly  used,  'timed  presentations  can  introduce  a  small 
sense  of  drama  and  revelation  to  the  CBI  lesson. 

5.    Use  verbal  synthesizers,  such  as  analogies,  stories,  and 

advance  organizers  to  relate  content  to  familiar  experience. 

Placing  unfamiliar  content  into  a  familiar  context  through  a 

simple  story  or  analogy  can  be  both  enlightening  and  motivating  to 

learners  (Curtis  &  Relgeluth,  1984) .    From  a  schema-theoretic 


conclusion  of  this  lesson,  you  will  be  able  to 


ii 


Another 


no 


Synthesizing  Strategies 
\  10 

■  I 

viewpoint,  creating  links  of  Meaning  between  hew  material  and 
existing  learner  knowledge  makes  the  new  material  more  easily 
recalled  and  sore  useful  when  it  is  recalled.    Often,  a  short 
story  or  parable  can  effectively  inform  a  learner  of  the  lesson's 
objective  without  the  nead  of  a  direct  statement  of  objectives  in 
abstract  terms. 

6.    Provide  integrated  practice  and  other  opportunities 
allowing  the"  application  of  multiple  skills  to  complex  problems. 
The  typical  tutorial  breaks  down  content  into  small  chunks, 
completing  each  chunk  with  a  practice  problem  or  two,  proceeding 
serially  through  a  great  deal  of  material.    Too  often,  there  is 
little  cumulative  learning,  that  is,  learning  based  on  prior 
learning.    This  problem  can  be  partially  addressed  by  making 
special  efforts  to  allow  for  "integrated  practice"  requiring  the 
learner  to  use  knowledge  and  skills  from  a  number  of  chunks  in  its 
solution.    The  Integrated  practice  can  take  the  form  of  a 
"mini-simulation"  if  the  subject   matter  allows.    This  notion  is 
somewhat  related  to  Bunder  son's  "work  models",  in  which 
increasingly  detailed  practice  environments  are  provided  to  the 
learner  (Bunder eon,  Gibbons,  DIsea,  &  KearsTey,  1981). 

Research  on  CS I  Strategies 

Although  we  make  reference  to  literature  in  cognitive 
psychology,  this  paper  is  far  from  a  psychology  paper.    Hor  is  it 
directly  aimed  at  practicing  instructional  designers,  Its 
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audience  can  be  termed  "instructional  researchers",  whose  research 
commitment  lies  somewhere  between  psychology  and  educational 
practice. 

In  1961,  Arthur  Lumsdaine  first  talked  about  a  "science  of 

There  is  an  important  "middle  ground"  between  a  basic,  science 
of  learning  and  an  applied  technology  of  educational  i 
method....    In  view  of  the  complexity  of  human  learning,  we 
can  reasonably  expect  to  find  few  universal  generalizations 
that  would  hold  for  all  classes  of  instructional  objectives, 
all  classes  of  learners,  and  all  conditions  of  instruction. 
Rather,  it  seems  evident  that  what  is  needed... is  a  series  of 
contingent  generalizations  which  take  account  of  the 
Interactions  of  variables...    (Lumsdaine,  1961,  pp.  497,  499); 

This  "science  of  instruction"  has  been  advocated   by  many 

others  (e.g.,  Simon,  1969,  1980;  Relgeluth,  Bunder  son,  &  Merrill, 

1978;  Glaser,  1976),  and  it  seems  to  include  these  features: 

1.  a  commitment  to  developing  prescriptive  principles  of  the 
form  "If  you  want  A  and  you1  re  In  situation  B,  then  do  C.M 

2.  a  commitment  to  empirical  validation  of  these  contingent 
principles. 

3.  a  commitment  to  economy  or  parsimony  of  theory,  to 
maintain  its  utility  to  the  practicing  Instructional  designer. 

What  methods  should  instructional  scientists  employ  in 
developing  a  knowledge  base?    Lumsdaine  (1961)  recommenda  as  a 
research  strategy  several  phases  of  factorial  experimentation, 
with  each  phase  building  on  the  lessons  learned  of  the  former.  We 
would  add  that  experimental  research  must  itself  be  balanced  with 
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careful  model -building,  hands-cm  try  out  by  practicing  designers, 
and  borrowing  of  existing  methods  that  have  stood  the  test  of  time 
(MacDonald-Ross,  1978,  1979).   v  > 

Research  in'CBl  strategies  Is  almost  an  ideal  setting  in 
which  to  test  developing  instructional  theories.    Because  of  the 
highly  controlled  nature  of*  CBI,  and  because  of  its  flexible 
data-gathering- capacity,  strategies  can  be  systematically  examined 
and  evaluated.'   The  product  of  such  research  may  not  be  a  single 
comprehensive  system  of  principles,  but  instead  a  rather 
disjointed  set  of  guidelines  and  rules  applicable  in  limited 
contexts.    In  any  case,  instructional  researchers  will  be  able  to 
provide  some  auch^needed  guidance  to  practicing  designers  who  are 
presently  working  feverishly  to  bring  products  to  market. 
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Figure  Caption 

Figure  K    Tree  diagram  showing  content  structure  for  use  as  an 
adjunct  aid  to  a  CBI  lesson; 
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ELECTRONIC  BOOKS t 
TOWARDS  A  THEORETICAL  FRAMEWORK  FOR  RESEARCH 

ANDREW  R.   J.  YEAMAN 
UNIVERSITY  OF  MAINE  -  PRESOUE  ISLE 

Abstract 

In  an  increasingly  technological  society  there  is  a  social 
nead  for  assigning  communication  tachnology  around  tha  perceptual 
abilitias  and  cognitiva  strategies  of  paopla.     Browing  inform- 
ation demand  has  craatad  additional  -pressure  on  emerging  communi- 
cation  technologies  to  provide  electronic  alternatives  to  the 
printed  page.     Aa  prose  is  still  ths  most  widely  used  method  of 
educational*  communication,  theory  should  converge  on  issues 
affecting  readers  of  both  the  printed  page  and  the  electronic 
display.     In  developing  electronic  books  there  is  need  for  a 
system  within  which  research  may  examine  relationships  between 
textual  material,  communication  technologies,  and  the  psychology 
of  readers. 

» 

Introduction 

A  new  technology  of  communication  is  being  created  which 
should  stretch  beyond  printed  paper.     Design  depends  on  contri- 
butions from  engineering  and  computer  science^  experimental  and 
applied  psychology  and  graphic  art  and  typography  (see  Figure  1>. 
Underlying  the  varying  positions  is  one  common  pretheoretical 
assumptions    reading  of  electronic  text  may  be  influenced  by 
characteristics  of  its  visual  presentation. 

The. electronic  book  may  not  only  replace  much  of  what  would 
have  been  printed,  but  stands  by  the  side  of  what  has  been 
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printed  and  eventually  co*»a  into  being        ite  own  authentic 
communication  medium.     Beyond  the  tcononic  preaeure.  to  -vol v., 
th.  electronic  bock  may  offer  authore  new  «ay.  of  conveying  mean- 
ing    It  may  ■Um.rtid.ri  control  of  text  by  orBeni*ation 
•imilar  to  database  atructure.     Thi.  would  be  the  ultimate  goal, 
to  eliminate  impedimenta  which  deeignera  place  btwean  author, 
end  reader..     There  will  no  longer  n«d  bo  a  eilent  intrusion  by 
tho  technoloBy  of  tout   (Yeemen,  1984). 

The  fMturti  of  a  theoretical  framework  for  raaaarch  on  tho 
electronic  book  are  th.  reading  environment r  tha  relationship  be- 
twMn  th.  .„thor  .nd  th.  r-.d.r,  th.  r..d«bility  of  th.  t.xt,  it. 
ch«r.ct.ri.tic.  ..  •  vi.u.1  Mdiu.  .nd  th.  r.«ding  l«v.X  of  th. 
r..d.r.     Th.  »o.t  r-.li.bl.  .nd  v.lid  *...urw  of  r..ding  .f- 
ficiency  .r.  li.t-d  in  th.  c.nt.r  of  Figur.  1.     Thi.  p.p*>  focu.- 
.,  on  th.  d.t.m<in.tion  of  legibility,   tow.rd.  ....mining  th.  r*- 
l.tion.hiP.  b.tw.n  ^gin-ring,  p-ychology,  th.  gr.phie  .rt.  .nd 
education  in  contributing  to  th.  d-v.lopm.nt  of  th.  .l^tronic" 
book. 

Screen  ReadinB  Technology 

The  lonB  end  cloae  viewinB  of ' electronic  diaplay  acreens  ia 
no  longer  the  rare  occurrence  it  once  wae  when  the  initial  appli- 
cationa  were  in  the  military,   in  naviBation  and  in  air  traffic 
control.     Such  diaplaya  are  currently  auppl«ntinB  the  printed 

a  *   

p.g.  -nd  th.  pr-.don.in.nt  vising  t..k  h..  ch.ng.d  from  ch.r.ct.r 
r.cognition  .nd  id.ntif  ic.tion  to  word  proc.ing  .nd  r..ding 
CCoh.n  *  C.rl.on,   19M».     Th.  Jncr....  in  CRT  u..  in  p.rticul.r 
h..  r.i..d  concrn  .bout  p.r«on«l  h..lth  by  l.bor  .nd  »°«m«nt 

* 
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agencies  in  a  number  of  countries.  Potential  hazards  in  vast  i- 
gated  so  far  include  radiation  amission,  airbom  chemical  con- 
tamination, workstation  dimension,  reflective  glare  and  psych- 
ological distress  (Rupp,  1981). 

The  engineering  standards  for  the  transmission  of  high 
quality  images  come  from  broadcast  television  (Cohen  A  Calson, 
1980) .     The  major  criterion  is  resolving  power  for  fine  detail 
(Snyder,    1973).     Gould  (1968)  refers  to  the  1941  FCC  decision 
that  television  should  equal  16mm  movies  in  average  condition  and 
show  209,000  half-tone  dots. 

Display  engineers  claim  to  have  accounted  for  legibility 
with  objective  measures  intended  to  evaluate  the  alphanumeric 
quality  of  CRTs  for  their  earlier  uses.  Sherr  (1979)  operation- 
al! zed  legibility  for  engineers  as  the  quantity  of  correct  ident- 
ifications made  by  the  display's  readers.  Laboratory  testing 
with  human  subjects  has  resulted  in  prescriptions  for  minimum 
character  height    (Shurtleff,  1980>. 

However,   through  the  use  of  instruments  generating  and  eval- 
uating sine  waves,   observations  are  most  commonly  made 
ind a pendent  of  direct  psychophysiological  consideration.  Human 
judgement  is  not  required  at  all.     Sherr  (1979)  considers  this  to 
be  objective  whereas  human  observation  ia  undesirably  subjective. 
Though  conceding  the  attractiveness  of  psychometric  techniques, 
he  claims'  sufficiency  would  require  excessively  costly  and  time-  . 


consuming  total  system  simulation. 

The  measure  preferred  by  engineers  to  estimate  human  visual 


performance  is  called  the  modulation  transfer  function  (MTF). 


Tha  display  resolution  is  analyzed  with  •  sine  wave  test  signal 
(Biberman,   1973).     Sins  msvs  response  across  a  CRT  spot  is  moder- 
ated by  changss  in  beam  current,  focus  and  off -ax is  conditions 
and  is  described  by  an  algebraic  equation  of  harmonics  known  as 
a  Fourier  transform  (Sherr,   1979) »     The  only  human  element  in  the 
equation  is  normal  visual  acuity  taken  as  3d*  detection  probabil- 
ity with  approximately  £38  lines  per  inch  "displayed  at  108ft- 
Lamberts  viswed  from  85  inches  and  an  angle  of  1  minute  of  arc. 
In  WTF  equations  normal  acuity  is  assumed  and  given  a  standard 
value  of  one  (Bi barman,    1973).     Banbury  (1982)  describes  this 
machine  model  of  human  perception  ae  the  golden  eye.     while  human 
vision  and  screen  parameters  may  be  discussed  in  common  terms  by 
looking  at  spatial  frequency  variation,  MTF  applies  to  picture 
recognition  much  better  than  it  does  to  the  recognition  of  dot 
matrix  alphanumerics  (Rogcwitz,  1983). 

Cakir,  Hart  and  Stewart   (1988)  warn  their  readers  about  the 
minimal  testing  of  display  legibility  with  human  subjects.  when 
it  does  take  place,  reading  performance  is  usually  quantified  as 
accuracy  of  rscognition  of  letters  or  single  words |  whether  or 
not  B  is  clsarly  distinguishable  from  R,  S  and  8.     Ths  variables 
in  such  a  visibility  test  may  be  distance,  character  size  and 
style  or  brightness  and  spacing.     Procedures  for  such  testing  are 
spelled  out  by  Shurtleff  (1988). 

/   _____    ^  ^  ^  ^ ._.  f   , 

Reading  Psychology  y 

Rsading  performance  as  a  psychological  construct  is  based  on 
the  task  of  rsading,  and  the  preferred  geometry  or  photometry  of 
single  letters  does  not  provide  a  base  for  judging  legibility  as 


a  iWMun  of  nadinfl.     »  link  with  ergonomics  rmireh  on  tele- 
vision  and  radar  viewing  may  not  bo  applicable  to  reading  tent 
from  electronic  displays  because  the  task  is,  different,  i.e. 
distinction  of  fine  detail  does  not  guarantee  legibility.  For 
instance,  dot-matrix  letters,   like  the  ones  on  this  page,  re- 
semble the  spots  of  color  in  a  pointillist  painting  which  require 
blending  by  the  viewer*  s' eye.     Dot  matrix  characters  can  be  read 
when  sufficient  detail  is  lost, that  the  image  of  continuous 
strokes  is  seen.     Enough  detail  must  remain  so  that  individual 
letters  are  not  confused.     Air  traffic  controllers  learn  to  re- 
cognize special  alphanumeric*  with  a  high  discrimination  and  a 
low  confusion  rate  between  characters.     The  nature  of  their  task 
differs  from  the  one  accomplished  by  readers  of  this  sentence. 

The  advantage  of  extracting  meaning  by  reading  woVds  over 
identifying  individual  letters  is  well  established  in  reading 
psychology  and  was  first  demonstrated  by  Cattail  who  used  a 
special  flash  card  apparatus  (1885).     Single  Istters  Were  named 
more  slowly  than  short  words  and  identification  time  for  words 
was  not  proport ionatn  to  their  length.     This  finding  has  been 
replicated  Many  times  in  subsequent  research  on  reading  but  its 
meaning  is  still  debated   (Dunn-Rankin,    1978i  Wright,  1980). 

Contrary  to  ths  engineer's  point  of  view,  text  legibility 
involves  the  complexities  of  reading  and  is  a  cognitive  issue, 
th us,~  pereeptua X~'f act brs  do"  not*  encompass  aTl~~of  the  human 
factors  involved  in  reading  from  CRTs.     From  the  visibility  of 
tsxt  it  cannot  be  inferred  that  the  text  is  acceptable  to  read 
without  strain  (Tinker,  1966). 
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Empirical  Studies  in  Typography 

Typographic  research  shows  text  legibility  decrease*  when 
empirically  based  type  convention*  are  disregarded.     Letter  sice, 
line  length  end  interline  spacing  ere  the  major  variable*  asaoci- 
ated  with  lower  comprehension,  slower  reading  speed  and  inef- 
ficient eye  movement*  (Tinker,   1965).     The  technology  of  elec- 
tronically displayed  tent  require*  *ub»tantiat ion  similar  to  that 
for  printed  tent   (Yeaman,  1984). 

A  contemporary  paradigm  for  typographical  re*mareh  ha*  been 
assembled  by  Bell  and  Sullivan  (19S1) i     "ft  cognitive/affective 
changa  occurs  in  a  reader  when  personality/ interest /reading  style 
etc.  characteristics  encounter  the  imperative/recreational /ad- 
visory purpose  of  the  material-  <p.  57).     It  also  may  be  defined 
as  the  argonomic  study  of  visually  presmnted  information  displays 
(Foster,    1973) . 

Applications 

The  af forts  of  graphic  daaignera  towards  developing  screen 
formats  for  text  have  concantrated  on  data  entry  * (Sal itx,  198&>v 
videotex  and  teletext   (Reynolds,   1979,   1982)  or  interact ivm 
videodisc  (Bork,   1981 f  DeBloois,   1988).     Their  typographic 
principles  stem  from  the  rational  foundations  of  programmed 
learning  taxtst     spacing  for  emphasis,  color  coding  to  convey 
meaning,  short  paragraphs  <;o  prevent  intimidation  of  the  studants 
and  so  on.     Aesthetic  preferences  are  also  a  factor. 
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Instruct i one 1  Technology 

Jon«f»tn  (1982)  States  the  purpose  of  the  technology  of  tout 
is  to  focus  "on  how  written  discourse  can  be  most  effectively 
presented"  (p.   ix),  whether  on  the  printed  page  or  the  electronic 
display  screen.     It  is  the  "application  of  a  scientific  approach 
to  text  design"  (p.  m)  and  is  rooted  in  the  paradigm  of  in- 
structional technology  (Heinich,   1970).     Xeplicit  techniques 
relate  to  the  organization  of  content  ss  ideas.'   Explicit  tech- 
niques such  as  advenes  organlzsrs  or  graphic  signals  provide 
tferoal  indication  of  the  text  structure.     Thsse  idsas  do  not  ex- 
tend  beyond  directly  instructional  purposes  to  encompass  mors 
general  reading.  ' 

Synthesis 

From  the  standpoint  of  theory  building,   Roufs  and  Bouraa 
(1989)  present  a  working  philosophy.     Both  hardware  engineers  and 
visual  researchers  need  to  examine  the  connection  between  the 
characteristics  of  the  observer  and  the  visual  image  requirements 
in  order  to  assure  that  the  display  pe forms , its  function  proper- 
ly.    Thou^  technical  and  economic  pressures  cause  display  dssign 
choices  to  be  made  hastily,  cooperation  between  the  two  groups 
would  be  of  benefit.     This  joint  endeavor  would  further  vision 

l  * 

theory  and  solve  practical  problems  such  as  assessing  the 
reader's  ability  and  nature  of  the  task*  both  previously 
neglected.     Considerable  international  interest  in  this  area  has 
been  shown  recently  by  two  conferences  on  Processing  of  Visible 
Language  (Holers,  Wro 1st ad  &  Bourne,   1979,   1980)  but  interdisci- 
plinary research  remains  rare. 
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Conclusion 

* 

Books  of  printed  paper  developed  over  a  period  of  hundreds 
of  years.     All  manner  of  corrections ,have  been  attempted  in 

printed  book  design  end  production  to  develop  a  psychophysical 

r 

fit  in  answer  to  empirical,  rational  and  intuitive  questions 
weighted  against  aesthetic  and  economic  factors.     There  is  not 
time  for  trial  and  error  development  of  the  electronic  book.  «n 
effort  must  be  made  to  build  cognizance  in  special  consumer  re- 
search communities,  such  as  education,  that  reading  of  text  dis- 
played on  screens  requires  attention  to  t echno 1 ogical/ psycho logi 
cal  problems  which  may  otherwise  be  neglected. 
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UATSON-GEGEO,  K.A.  ETHNOGRAPHY  81/670 

WELLIVER,  P.  PERSUASION  80/220 

WELL1VER,  P.  ATTITUDES  80/220 

WELLIVER,  P.  PRESERVICE  TEACHERS  80/220 

WHITAKER,  J.  ILLUSTRATIONS  80/569 

WHITAKFR,  J.  REtF VANCE  80/569 

WHITE,  8.H.  PRACTITIONER  79/144 

WHITE,  B.H.  RESEARCH  79/144 

WIECKOWSKI,  T.  COLOR  80/594 

WIECKOWSKI,  T.  PICTORIAL  RESEARCH  80/594 

WIECKOWSKI,  T.  COGNITIVE  STYLE  80/594 

WILDMAN,  T.  EVALUATION  80/630 

W ROMAN,  T.  INSTRUCTIONAL  TECHNOLOGY  80/630 

WILDMAN,  T.  LEARNING  80/460 

WILDMAN,  T.  TASK  ANALYSIS  80/460 

WILDMAN,  T.  MATCHING  LEARNING  THEORY  80/630 

WILLIAMS,  D.M.  SELF  CONCEPT  82/621 

WILLIAMS,  D.M.  ELEMENTARY  MEDIA  CENTERS  82/621 

WILLIAMS,  J. A.  INSTRUCTIONAL  DEVELOPMENT  80/445 

WILLIAMS,  J.A.  THEORY  84/563 


v  — ^  t  ... 

AUTHOR'S  NAME  DESCRIPTOR  YR/PA6E 

WILLIAMS,  J.A.  EV/UUATIOn"             ~  84/563* 

WILLIAMS.  J. A.  FIELO  OEPENOENCE/ INDEPENDENCE  80/445 

WILLIAMS,  J.A.  INSTRUCTIONAL  DESIGN  84/563 

WINN,  B.  FIELO  TEST  79/580 

WINK,  B.  INSTRUCTIONAL  MEDIA  79/580 

WINN,  B.  RESEARCH  84/607 

WINN,  B.  BRAIN  RESEARCH  83/736 

WINN,  B.  EDUCATIONAL  TECHNOLOGY  84/607 

WINN,  B.  INSTRUCTIONAL  DESIGN  83/736 

WINN,  B.  PUBLICATIONS  84/607 

WINN,  W.  VISUAL  LITERACY  80/646 

WINN,  W.  THEORY  80/646 

WINN,  W.  INFORMATION  PROCESSING  80/646 

WINN,  W.D.  OIAGRAMS  81/715 

WINN,  W.D.  LEARNING  81/715 

WINN.  B.  VISUAL  LEARNING           —  82/638 

WISE,  R.E.  ICONIC  STIMULUS  82/671 

WISE,  R.E.  COGNITIVE  SKILLS  82/671 

WITHAM,  J.  CO-ORDINATION  80/527 

WITHAM,  J.  SUBSUMPTIYE  SEQUENCING  80/527 

WITHAM,  J.  -COGNITIVE  SKILLS  80/527 

YACOBACCI,  P.M.                EVALUATION  82/105 

YACOBACCI,  P.M.                SPECIAL  EDUCATION  82/105 

YACOBACCI,  P.M.                 INSTRUCTIONAL  SYSTEMS  82/105 


9 

ERIC 


948  919 


1985  SUBJECT  INDEX 


DESCRIPTOR 

AllTUf  tD  i  T  yAMC 

AUIHOK  5  NANt 

TK/rw 

a/*  lit  rurufuT 

ACHIEVEMENT 

mllNArlNt  M»u. 

OO/iUl 

ACVUlSlllON  SMLLS 

a\i  i  cu    a  c 
Al  Mil  T  CUT     M  .1 

oo/cy 

At  r*tUDA 

ALutttKA 

09/1 

AUAI  VT1P    AUTI  1TV 

ANALYIlv  ADILIIT 

TO  /  IjpJ 

r&CL  CTitnv  M£  Tun  rut  j  nr  v 
LASt  51 UUT  nt  InUUOLUbT 

KING,  J.N. 

run  nocm 
CHlLOHEN 

00/01 J 

COGNITION 

f*  rvf*  i|  f  T  f  f  ft  Al 

COGNITION 

rORMAN,  u«c • 

ot)/lo*» 

COMMUNICATION  PROGRAMS 

i/  fur*      l  u 

KING,  J.W. 

yi:  mi  Q 
CK>/410 

COMPARISON  STRATEGIES 

ALLEN,  U.S. 
STEVENSON,  R.B. 

OtZ  /Of  j 

COMPUTER  LITERACY 

09/797 

COMPUTER  LITERACY  ASSESSMENT 

•r/*i  iaahi      aw  a^ 

TOKARDI,  n.M. 

Oil  JU4.il 

oS/ooO 

o^iiAiiTrii    AFf  i  pf  rn    t  iicTfi i ii*T  Tint 

COMPUTER- ASSISTED  INSTRUCTION 

pnr*7rn  Tx~Ia  1 

ob/Z&c 

COMPUTER -ASS I ST ED  INSTRUCTION 

HANNArlN,  M. 

ULw  /OtO 

oS/Jcbd 

COMPUTER-BASED  INSTRUCTION 

U  A  Af  C  fTA  ffl 

BAKER,  r . 
lUUbtRft  H«t. 

COMPUTER-BASED  INSTRUCTION 

OIL  /ClCfttO 
09/007 

uJWOTER-tiAStD  lNdlKUClIUN 

StiUNtK.  C««J« 

uc  /uao 
OD/OOb* 

rriuni itc n   Diem   i liCTOi ir*T i rtii 

COMPOTER-BASED  INSTRUCTION 

AiCt   1        ftjf  ft  1 

oD/ 140 

COMPUTER-BAStU  INSTRUCTION 

.  MIL SON .  D.b. 

OO/ifOi 

COMPUTER-BASED  INS1 RUCTION 

TAYLOR.  W. 

DC  i\  ikU 

COMPUTER-BASEO  INSTRUCTION 

DWYER,  F. 

nt  ii  ft  / 

oo/14o 

COMPUTER-BASED  INSTRUCTION 

ft  ft t r—  ■  iip  i 

CANELOS,  J. 

ob/140 

COMPUTER-BASED  REINFORCEMENT 

t  ft  M.  1              lAI              f  ft       1  1 

DaLiON,  d.w. 

55/101 

COMPUTER-BASED  REINFORCEMENT 

HANNAFIN,  M.J  • 

OD/101 

rf>ft  *^.ft.aftYfeB  • 

COMPUTERS 

WirrOLETTO,  R. 

ot>/ilo 

COMPUTERS 

MATTU I  AC  M 

MAI  IHIAS.  Pi- 

od//0o 

COMPUTERS 

ca  i  tcuiiliv     n  c 
SALISdURt»  U.r. 

COMPUTERS 

SHAH »  S • 

OD/ r0%) 

r/tUOhYL  lie* 

COMPU 1 ERS 

VtNSLLft  U* 

OD/ /UJ 

COMPUTERS 

UArtoRT  9  U« 

OD/ft)10 

COMPUTERS 

liRlBBLE,  M. 

00/ JlO 

UWUTlRS 

SHROCK,  S.A. 

00/ /0%5 

COMPUTERS 

AUACTACfiCLT  1 

ANASI ASOrr «  u • 

03//UJ 

CONCEPT  LEARNING 

LiADT       O  A 

HAR1  9  R.A. 

oof Sod 

COURSEWARE 

A  1  C  C  A  kitt  fl  T  A,]  t  |J 

ALESAN0RIN1 9  K. 

(it  /I  ftj 

fi  tfMl  t  PI  Jl    i             iit  r.,        1  ■.tile 

CURRICULUM  UlRtCioRS 

1        ft             Kft  | 

HO,  M.L. 

nr  li Ai      n  a 

REHN,  R.A. 
SALISBURY,  D.F. 

DOGMATISM 

00/30/ 

l  ft  •  ■    1          aft  ft  lf%       f~l  M      fs       T       c  - 

DRILL  AND  PRACTICE 

U£  iltAL*2 

ELECTRONIC  BOOKS 

YEAMAN,  A.R.J. 

85/921 

EMPOWERED  LEARNING 

STEVENSON,  R.B. 

o5//y/ 

ENCODING 

[il     l    t     ftllM  | 

BELL  AND ,  J  • 

ob/o/ 

ENCODING 

TAYLOR,  W. 

ob/tt/ 

V  ft  1  f  *  4  \f>  f  ft  1 1  • 

ENCODING 

CANELOS ,  J . 

oo/o/ 

tNCOUlNb 

nuv  LTD  c 

UNYER,  r. 
NISHIK^A,  S.S. 

(Ik  /u7 
OD/O/ 

FEEUlMCiC 

ilk  /k^Ii 
OO/04U 

FlELu  DEPENyENCE/lNULPENDENLE 

MOORE,  DM. 

QL  /AUk 

FILM  THEORY 

DEfiRAhr  ,  J « 

Ok  /I  VC 

oo/lco 

GKArHl to 

ALL jMNi/ninii  ,  N* 

oo/  io 

ILLUSTRATIONS 

HURT,  J. A. 

85/392 

ILLUSTRATIONS 

ANGL1N,  G.J. 
MOORE,  D.h. 
HURT  IN,  J. A. 

85/57 

IMAGERY 

85/485 

IMAGERY 

85/386 

INCENTIVE 

ALBRIGHT,  M.J. 

85/1 

eric  149  920 


DESCRIPTOR 


AUTHUR'S  HM. 


YR/PG 


INDIVIDUAL  DIFFERENCES 

ftELLANO  J 

ftS/t  d& 
ODf AHw 

INDIVIDUAL  DIFFERENCES 

CANELOS  J 
wnra&WwO f  w  • 

«S/1  Afi 
09/ 1  •MI 

INDIVirUIAl  niFFERFNrFS 

Aft 

I  NO  I V IDUA1   til  FFFRFNrE  S 

OUYFft  F 
wnl  Cr\ ,  r  • 

TO/ iW 

INQTtfinilAI  niFFERENr.ES 

TAYLOR  U 

US /I  AA 

INSTRUCT I QU 

A  ft  W  |  f%U  W  ■  A  WW 

FUENCH  M 
r ratra  wn  9  n • 

INSTRUCT I 0NA1  DESIGN 

nUYEB  F 

ww/Of 

INSTRUCTIONAL  DESIGN 

irawl  ItWvl  AWffFlL  WtWlUW 

kEI  1  AND  .1 

IK/R7 

I NSTRUCT 1  OMAI   Dt  SIGN 

IrfWl  (\UV  1  A  UHML   ML.  J  A  \U% 

tayi  or  y 

AS/M7 
Ow/0/ 

INSTRUCTIONAL  DESIGN 

CANEI  OS  .1 

Ow/O/ 

INSTRUCTIONAL  MF THUDS 

Rt-HN     R  A 

INSTRUCTIONAL  STRATEGIES 

FRENCH  M 

AS /I  ttl 

INSTRUCTIONAL  TECHNOLOGY 

A  ra  W  1  i\Uy  1  A  WF1#^4-     1  Lvf  lifvLUU  1 

MQRIN  A 
nwraxra  9  fi  ■ 

HS/AQQ 

INSTRUCTIONAL  TECHtfOU&Y 

*raw  1 ra, w  i  AviWL   i  bwnwwvv i 

(4AUN0N  H 

VnQtlUn  f  f\m 

oo/coc 

INSTRUCTIONAL  TELEVISION 

111  J  1  nUy  1  A  Wink     ILLVr  1 1  Jlwfl 

SAL CEDO    A  M 

09/  www 

INTEkAPTIVE  THE  VISION 

ROKlNSON     R  S 

f\WwAraOwnf  fSmOm 

09/v£w 

I MTV II APT  T  VP  V 1 1  lEl  ■ 

1  YllESS     A  1 

wk  'AK9 
Q9|  *tOC 

LCHKralraw  w  1  f\MI  uulL3 

UWlC.ra9  rm 

TO/  .^rw 

LtAKNlNb  oIKAItblto 

TaVI  f\U  tJ 

QC  /DA  O 

TO /OHO 

LtAKNlNb  ol KAI tblto 

PAiJCi  nc  i 
t/VNtLUo  9  J  • 

TO/CHfO 

LtAKNlNb  J>lKAItblto 

Ail CiiiM  c  Li 

NltnULOf  K. 

uC  /Oil  u 

TO/o4o 

1  L  A  DM  T  kit  *  CTDATCi*TITC 

LtAKNlNb  bIKAltblto 

pa un  ric  i 
UAratLUo 9  J. 

ODf OHO 

LtAKNlNb  SlYLtb 

CTflklC  D 
blUNt9  Hm 

09//9U 

LtAKNlNb  SlYLtw 

KLUUn 9  1 

TO/  /  ww 

1  CADUTLtf'    CTV1  L  C 

ALuLK 1 LK  9  K. 

TO/ /DU 

LLAKralrau  01  iLtw 

UwUN 9   0 • 

TO/  /ww 

LLnHJf lira  01  i LLO 

HFRRY  T 

Ow/ /9W 

SIMINSON     M  R 
OAnwraOWrat  rl«f%» 

09/  /  WW 

MA  THE  MAT 1 TS 

(40FT7FRI PO  L 

VW/A9C 

MATHEMATICS 

HANNAFIN  M 
rmrarafir  a  ra  9  n« 

Ow/ CwC 

MEniH  IITII  I  7AT  1  r.iu 

SE  I  OMAN     S  A 

RS/87M 

09/ w/  0 

raw  1 L 1  nJ\  a  Ho 

OUYER  F 
um  era  9  r  • 

09/ OHO 

NOTETAItlW; 
ItU  1  &  1  MIS  a  rau 

NICMOi S  R 

ra  A  wTIWi-O  9  f\m 

O9/0*t0 

NflTf  TAX  Iftfti: 
raw  1 L  I  mn  1  rau 

PANEI  fl'S  .1 
vMrauUWO t  w  • 

Ow/Cf  O 

raw  I L  1  A*  A  raw 

Tayi  or  y 

Ow*/ OHO 

rLIOwrlwlwn 

TO/  /  ww 

urDcii  ac  f  i  in 

>i  rvra^Ura  9  rT#  n  • 

-tti*  /7a;u  - 
09/ /ww  , 

rtKoUAolUN 

5 I Urat 9  Hm 

09/ /9U 

DLTDCl 1  AC  T  MAI 

rtKoUAMUN 

vi  rviv  T 

O9//9U 

rLKOUMalUra 

lit-  f.t  uTt  U  LI 

TO//9U 

Ut  DC1I ACT fUl 
rLIOUMwlwFl 

LUwK 9   o . 

oD/ /ww 

DD/lCt 

rNUwC 

MrabLlra,  u.J. 

TO/9/ 

DHOVP 
rKwOC 

09/w?4 

911771  r  cm  vtum 

UftUTTU      1  A 
nUralira9  w«M« 

fit;  / 

09/900 

RF IraFORCFMtNT 

ALinrWnwWrHvfil 

UALTON    D  W 
i/Ak  i  w  ra  9  w  •  n  • 

OW/ 1U1 

RESEARCH 

FRENCH,  M. 

86/220 

RESEARCH 

MOLINA,  R.R. 

b5/479 

RESEARCH 

YEAMAN,  A.R.J. 

85/921 

RESEARCH 

BECKER,  A. 

85/72 

SOCIAL  INTERACTION 

S1LVEKS1E1N,  M»A. 

85/717 

SPATIAL  VISUALIZATION 

MOLINA,  R.R. 

85/479 

SPEECH 

OLSON,  J.S. 

85/558 

SYNTACTIC  PLACEMENT 

HART,  R.A. 

85/332 

W  tM  921 


DESCRIPTOR 

i 

AUTHOR'S  NAME 

YR/P6 

SYNTHESIZING  STRATEGIES 

WILSON,  B.G. 

85/901 

TASK  PERFORMANCE 

SEIUNER,  C.J. 

85/689 

TASK  PERFORMANCE 

TOUGER,  H.E. 

85/889 

TEACHER  BURNOUT 

SEIDMAN,  S.A. 

85/6/8 

TEACHER  SOCIALIZATION 

GRI88LE,  M. 

85/418 

TEACHER  SOCIALIZATION 

GAMSKY,  D. 

85/318 

TEACHER  SOCIALIZATION 

MUFF  OLETTO .  R. 

85/318 

TEACHING  ANALYSIS 

KOETTING,  J.R. 

85/437 

TEACHING  INSTITUTIONS 

HO,  M.L. 

85/372 

TECHNICAL  PRESENTATIONS 

OLSON,  J.S. 

85/558 

TELEVISION 

DE GRAFF,  J. 

85/125 

TELEVISION 

STORM,  S.R. 

85/813 

TEXT  DESIGN 

SMITH,  P.L. 

85/783 

TEXT  LAYOUT 

AMEDEO,  D. 

85/280 

TEXT  LAYOUT 

GRAHINGER,  R.S. 

85/280 

THEORY 

MORIN,  A. 

85/499 

THEORY 

BECKER,  A. 

85/72 

VIDEO 

FOSNOT,  C.T. 

85/164 

VIDEO 

FORMAN,  G.E. 

85/164 

VIDEO 

KOETTING,  J.R. 

85/437 

VIDEODISC  SYSTEM 

SILVEHSTE1N,  M.A. 

85/717 

922 
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CUMULATIVE  1979-1984  SUBJECT  INDEX 

YR/PA6E 

DESCRIPTOR 

AUTHOR'S  NAME 

* 

ABSTRACT  LEARNING 

CAREY,  J.O. 

81/105 

ABSTRACT  LEARNING 

HANNIFIN,  N.J. 

81/105 

ACADEMIC  SUCCESS 

BEDNAR,  A.K. 

79/303 

ACADENIC  SUCCESS  - 

SCHWEN,  T. 

79/303 

ACHIEVEMENT 

DWYER,  F.M. 

82/54 

ACHIEVEMENT 

PARKHURST,  P.E. 

82/81 

ACHIEVEMENT 

LAMBERSKI,  R.J. 

79/417 

ACHIEVEMENT 

JOSEPH,  J.H. 

83/357 

ACHIEVEMENT 

JENNINGS,  T. 

80/280 

ACHIEVEMENT 

REGENSCHEID,  J.K. 

83/643 

ACHIEVEMENT 

JENNINGS,  T. 

82/54 

ACHIEVEMENT 

.OBERTS,  D.M. 

79/417 

ADMINISTRATORS 

CARL,  D.L. 

84/99 

ADMINISTRATORS 

HOELSCHER,  S. 

84/99 

AESTHETICS 

MCISAAC,  M.S. 

81/428 

AFFECTIVE  RESPONSES 

ROBINSON,  R.S. 

81/535 

ALGORITHMIC  INSTRUCTION 

GERLACH,  V. 

80/217 

ALGORITMUC  INSTRUCTION 

SCHMID,  R. 

80/440 

ALGORITHMIC  INSTRUCTION 

GERLACH,  V. 

80/440 

ALGORITHMIC  INSTRUCTION 

VALACH,  M. 

80/440 

ALGORITHMIC  INSTRUCTION 

SCHMID,  R. 

80/217 

AMERICAN  SE 

HARRISON,  R.T. 

83/776 

AMERICANESE 

CROSSMAN,  J. 

83/776 

ANALYSIS 

n  link  ■  tJ  #  v 

HANNAf IN,  M.J. 

82/325 

ANXIETY 

TWINER,  P.M. 

82/581 

APTITUDE 

FRENCH,  M. 

83/226 

APTITUDE 

ANGLIN,  J.B. 

81/1 

APTITUDE 

FRENCH,  M. 

84/178 

APTITUDE 

PECK,  M.L.  , 

83/561 

APTITUDE 

SCHWEN,  T.M. 

81/1 

APTITUDE 

ANGLIN,  G.J.' 

81/1 

ASSESSMENT 

TURNER,  M.L. 

79/552 

ASSESSMENT 

ERNEST,  P.S. 

82/278 

ATI 

SCHWEN,  T.M. 

81/1 

ATI 

ANGLIN,  G.J. 

81/1 

ATI 

n  ■  4 

ANGLIN,  J.B. 

81/1 

ATI 

PARKHURST,  P.E. 

79/68 

ATTENTION 

ww  w    W   wrm  ww  y)     m  w  If 

BRAVERMAN,  M. 

81/78 

ATTITUDES 

GRABOWSKI,  T." 

"  80/220 

ATTITUDES 

KLOOCK,  T.R. 

82/439 

ATTITUDES 

WELLIVER,  P. 

80/220 

ATTITUDES 

SIMONSON,  M.R. 

82/561 

ATTITUDES 

HODGES,  Y.A. 

82/360 

ATTITUDES 

WWW     9     WW    *    ^P*  ■»»  V*?  W 

SIMONSON,  M. 

82/439 

ATTITUDES 

a  1  •    •   «I   ■  War  M  wr 

SIMONSON,  M.R. 

80/473 

ATTITUDES 

SIMONSON,  M.R. 

79/521 

ATTITUOES 

ORESANG,  E.T. 

82/256 

ATTITUDES 

REEVES,  W.J. 

82/360 

ATTITUDES 

SIMONSON,  M.R. 

81/586 

ATTITUDES 

SAVE NYE,  W. 

83/668 

ATTITUDES 

COOK,  S. 

82/439 

ATTITUOES 

¥ p  !   1  •  '  pp  PP  PP 

SHRIGLEY,  R. 

80220 

ATTITUDES 

GRAY,  J. 

62/360 

AUOIOVISUAL  PRESENTATION 

MAIN,  R. 

79/267 

AUDITORY  LEARNING 

OLSON,  J.S. 

83/517 

AUDITORY  LEARNING 

WiON.  J.S. 

84/414 

Hi  923 

DESCRIPTOR  AUTHOR'S  NAME  VR/Pfe 


AIIA1TAOV  1  PAD  Nf  Mil 

orDQV    I  M 
OtKHT,  Lfffl. 

83/517 

A10AI    f  fttCTDItTT  f  AM 
AlmUL  lltalKOvlION 

orp*    if  i 

Ol/C?? 

AIDAI    f  UC  TO  1  ITT  f  Ail 

AUKAL  1  Hamuli  IUW 

Ol/CO) 
OJ/DOJ 

aibai  ororroTTAu 

AUWl  rcKCtr 1  aOtI 

oofnarc  u 

A9/1  KA 
70/ t A t 

aw  mutton pat  t  ah  opvtpu 

cucDfrr    n  f 

IV  f flMHttif CATTftfl  0FVTFU 
Af  UimuniLAI  lOW  KC7ILO 

UAQfAU      1  A 

70/1  AA 

ariiAvf  aoai  no  if  cti  wrc 

ABJifll  ft    T  f 

A9/1 K 
OC/ 13 

•fuavtaoai  nairpTtifrc 

DUf  AO 

OruAlff  AOAI    AB  ITPTfWTC 

BEHAVIORAL  OBJECTIVES 

r  ri  Ail    r  i 

70/ OO 

BCUAU f  AOAI    Aft  tfrTf  IHTC 

BEHAVIORAL  OBJECTIVES 

GERLACH,  V.S. 

73/ Co 

OCiJAUf  AOAI    Aft  1C/*Tf  UtTC 

BEnAV  I  ORAL  OBJECTIVES 

GERLACH,  V.S 

oruAwf ah 4i  ao  trrTtucc 
DtnAViUKAL  UBatClIVtS 

nuvro    r  m 

09/1  C 

52/10 

OrUAtffAOAl  AOtTPTfl/rC 

BEHAVIORAL  UoJtCUVtS 

cruuin    o  p 
/  oLmiu9  K»t. 

ir  it  ti  Tunc  *  t 
/     wtRNINltj  •  I.. 

DUNN9  w. 

70/9A1 

BEHAVIORAL  OBJECTIVES 

QO  /CA 

DCUAUTAHAI    AD  t£ATf  UITC 

BEHAV IORAL  OBJECTIVES 

DA /I  OA 
80/190 

Ob HA VI URAL  OBJECTIVES 

nuvro    r  aa 

OO /CA 

DCUAIfflU)Al    AO  TTPTf  UTC 

BtHAVIWAL  OBJtCUVtb  / 

Or  UAH  TAD  At    AO  tTPTt  IXC 

MAT  II  D 

nAlN9  R. 

70/9A7 

oqatTAM  O 
OKA 1  I Unt  Dm 

on/1 oa 

OCUAUfAOAl    CPTrAiPr  / 

BEHAVIORAL  5C I^NvE  / 

CI  ruf  MH     M  1 

7Q/77 

1311* 

dti  tuAiiAi    rniirAT tau 

BILINGUAL  EDUCATION 

Ii  ADD  f  C  Ail  D 

HARR ISUNff  K9 

OA/OA9 

BO/202 

Offl  fAfAlftAI  rfXtTATfrtll 

BILINGUAL  EDUCATION 

DfTlfADA  A 

KlwKAKUff  U« 

ou/202 

BILINGUAL  LEAR NEK 5 

1  AAAOCDCI/T  D 

UVIBfcRSKl  y  Kff 

80/1 

DTI  ff  tiff  1 A 1      |  f  ADlff  AC 

BILINGUAL  LEARrERS 

ArrtirnA  r 
AttVtDU,  t. 

OA/1 

W/l 

Dl  ATtf  iLHif  TF    |  PAH  AIT  14/* 

BLACK/WHITE  LEARNING 

LAMBERSKI f  R.J. 

70/A1 7 

J3fHl7 

Dl  A  4*1/  /LMJf  TC    1  CTrtOAlf  AJI* 

BLACK/WHITE  LEARNING 

DAOrOTC      A  M 

70/A1 7 

131 ^Xf 

DDA  f  11    Af  CTAOru 

BRAIN  RESEARCH 

oroortrAD  o 

83/ / Jo 

DDA  T At  DCCCAOrii 

BRAIN  RESEARCH 

Uf  Nil  o 

07/77C 

O J/ /Jo 

an  a  t  ii  orcrAoru 

BRAIN  RESEARCH 

o J/ / 30 

DDA  Til    LI  A  Iff  C 

BRA  Iff  HAVES 

UTMrC      C  1 

82/ Jo2 

r  ADCCD c 

CAREERS 

c  Awe  jyvr  u 
jAVtWTtff  w. 

O^/AAfl 
53/ Do  8 

rut i nor  u 
CHILDREN 

UAMilAriM     M  1 
ttAWIMr  lUff  n.  J. 

09/770 
52/335 

CHILDREN 

CATTT     0  F 
OA it lf  K.t. 

70/AC7 
/¥/^D/ 

rut i  notki 
CHILDREN 

OAOAM     1  1 

70/1  CO 
/9/195 

CINEMATIC  ELEMENTS 

DADfUCAil      D  C 

RUBINSUNff  K. 3« 

Ol /C1C 

CO-ORDINATION 

or  i  #*ri  i  itu  r 
REIGELUTHff  C. 

DA If OT 

SO /be  7 

CO-ORDINATION 

STEIN,  F. 

WJ/5Z7 

flllMliATf  All 

CO-ORDINATION 

UTTUAAA  1 

WITHAMff  J. 

OA /C07 

80/SZ7 

rA/«tlTT  f  llf?    ART  f  Tf  tT\C 

COGNITIVE  APTITUDE 

OCAMAD       A  f 

BEDNAKff  A. K. 

70 /7A7 

79/303 

rr^m Tf ur  AOTfTimr 
COGNITIVE  APTITUDE 

1  AAADCDClff  D 

LAnBtRSKI v  K. 

70/7A7  a 

/9/»W3  * 

COGNITIVE  EFFECT 

OA/1 

80/ J 

tOuNITlVE  trrttt 

ACt Vtwf  C. 

Aft  /  f 

80/1 

riw*m  T  f  llf    i  r  ADUTUP 

COGNITIVE  LEARNING 

DAl/V      D  /* 

BUVYff  K.t. 

oi  ioc 
81/30 

r/vrtif Tf uf  ifAOAiTAii* 
COGNITIVE  LEARNING 

MtBKlutff  S.u. 

D7  /£D 

82/59 

CUwIITIVl  LtARNING 

nuvro    r  m 
UWYcKff  r.n.  ^ 

Q9  /<D 

62/09 

COGNITIVE  LEARNING  • 

fit  bo  1 1  ff  L»d. 

01 JAAC 

51/449 

r ai^ai tt i ur  Cl/f  1  1  c 
CUuNIT  1VE  SKlLLb 

or  T  PC k MTU  "  P 

OA/C97 

50/92/ 

COGNITIVE  SKILLS 

uTcr    o  r 
WISEff  R.t. 

09 /C71 

82/0/1 

PA^lJfTf Uf'   Cl/f  1  1  C 

COGNITIVE  SKILLS 

LlTTLlAM'  1 

WITHAMff  J. 

OA /C97 

80/927 

J*A^AlfTftfff    CVf  1  1  C 

COGNITIVE  SKILLS 

CTT  Til  r 

STEIN,  F* 

OA /C97 

50/927 

r aj*aj f Tf  yr  ctvi  r 
C0GNI44.VE  STYLE 

1APAOC      0  1 

JAtlKfSff  K.L. 

OO  /70C 

82/395 

PA^AlfTf  ur    CTVI  C 

COGNITIVE  STYLE 

OLSONff  J.S. 

D7/C1 7 

83/91/ 

rnciiTTTur  ctvi  r 

•  roc    A  A 
LtrS,  A. A. 

OA/  701 

50/351 

rAAiifTiur  ctvi  r 

oroov    i  u 
DCKKTff  L.n. 

07/K1 7 
53/91/ 

f  ACfiTTI  VF  *TVl  F 

oui\n vffA  iff  n .  w . 

JONASSEN,  D.H. 

COGNITIVE  STYLE 

83/329 

COGNITIVE  STYLE 

STREIBEL,  M.J. 

81/624 

COGNITIVE  STYLE 

AE8RY,  L.H. 

84/34 
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COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLE 

COGNITIVE  STYLES 

COLOR 

COLOR 

COLOR 

COLOR 

COLOR 

COLOR 

COLOR 

COLOR 

CCMPWNICATION 

COMPREHENSION 

COMPREHENSION 

COMPREHENSION 

COMPREHENSION 

COMPREHENSION  v 

CGMPREHENSION 

COMPREHENSION 

COMPREHENSION 

COMPUTER  ANXIETY 

COMPUTER  ANXIETY 

COMPUTER  ANXIETY 

COMPUTER  ANXIETY 

COMPUTER  SIMULATION 

COMPUTER-ASSISTED  INSTRUCTION 

COMPUTER-ASSISTED  INSTRUCTION 

COMPUTER -ASSISTED  INSTRUCTION 

COMPUTER-ASSISTED  INSTRUCTION 

COMPUTER -ASSISTED  INSTRUCTION 

COMPUTER-BASED  INSTRUCTION 

COMPUTER-BASED  INSTRUCTION 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

COMPUTERS 

CONCEPT  LEARNING 

CONCRETE  LEARNER 

CONCRETE  LEARNING 

CONCRETE  LEARNING 


JONASSEN,  O.H.  81/233 
JONASSEN,  O.K.  80/293 

OLSON,  J.S.  84/414 
SCHNEN,  T.               s  79/303 

*WE,  84/331 

SMITH,  P.L.  84/487 

MCCONBS,  B.L.  84/331 

WIECKQHSKI,  T.  80/594 

BEONAR,  A.K.  79/303 

ATAN6,  C.I.  84/1 

BERRY,  L.H.  83/46 

WIECKOMSKI,  T.  60/594 

BERRY,  L.H.  82/21 

LAMBERSKI,  R.J.  79/417 

ROBERTS,  D.M.  79/417 

LAMBERSKI,  R.  80/337 

LAMBERSKI,  R.J.  82/64 

EL-6AZZAR,  A.I.  84/127 

ANDERSON,  C.  80/35 

TANTIBLARPHOL,  S.  84/499 

LEGENZA,  A.  79/351 

ROBINSON,  R.S.  84/466 

PARKHURST,  P.E.  82/81  * 

SEWELL,  E.H.  79/496 

HUGHS,  L.H.  84/499 

BRODY,  P.J.  79/351 

MCGRADY,  D.S.  84/354 

SIMONSON,  M.R.  84/318 

SIMGNSON,  M.R.  81/549 

MAURER,  M.M.  84/318 

ROHNER,  D.J.  81/549 

EHRLICH,  L.R.  79/631 

HAAS,  N.  84/402 

NELSON,  J.  80/389 

STORY,  N.  ,  84/402 

MOSLEY,  M.L.  84/402 

REGENSCHEID,  J.K.  83/643 

KING,  F.J.  84/260 

ROBLYER,  M.D.  84/260 

BRUCE,  K.L.  84/331 

RAGAN,  T.  84/433 

ROSEN,  T.  83/719 

HANNAFIN,  M.J.  83/295 

COLE,  0.0.  83/295 

CARL,  D.L.  84/99 

BURROWAY,  R.L.  84/56 

RAGSDALE,  R.G.  82/543 

HANIEWICZ,  I.  83/719 

HOFLSCHER,  S.  84/99 

MCCOMBS,  B.L.  84/331 

SIMONSON,  M.R.  84/318 

ROSENSWEIG,  D.  83/719 

MAURER,  M.M.    '  84/318 

TURNER,  P.M.  ,82/581 

KURFISS,  R.  80/327 

CAREY,  J.Q.-  81/105 

HANNIFIN,  M.J.  81/105 
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CONSUMERS 

CONTENT  TREATMENT  INTERACTION 

CONTINUING  EDUCATION 

CONTROL  FUNCTION 

COORDINATE  CONCEPTS 

COORDINATE  CONCEPTS 

CRITICAL  DIALOGUE 

CRITICAL  DIALOGUE 

CROSS  CULTURAL  ANALYSIS 

CUEING 

CUEING 

CUEING 

CUEING 

CULTURAL  VARIATIONS 

CURRICULUM  THEORY 

DEMOGRAPHIC 

DEMOGRAPHIC 

DENTAL  HYGIENE 

DENTAL  HYGIENE 

DESIGN 

DIAGRAMS 

DIAGRAMS 

DWYER  RESEARCH 

DWYER  RESEARCH 

EDUCATION 

EDUCATIONAL  DEVELOPMENT 
EDUCATIONAL  TECHNOLOGY 
EDUCATIONAL  TECHNOLOGY 
EDUCATIONAL  TECHNOLOGY- 
EDUCATIONAL  TECHNOLOGY 
ELABORATION  THEORY 
ELEMENTARY  MEDIA  CENTERS 
EMBEDDED  FIGURES  TEST 
EMPIRICAL  RESEARCH 
EMPIRICAL  RESEARCH 
ENCODING 
ENCODING  • 
ENCODING 
"  ENCODING. 
ENCODING 
ENCODING 
.  ENVIRONMENT 

ENVIRONMENT 

ETHNOGRAPHY 

ETHNOGRAPHY  ■ 

ETHNOGRAPHY 

EVALUATION 

EVALUATION 

EVALUATION 

EVALUATION 

EVALUATION 

EVALUATION 

EVALUATION 

EVALUATION 

EVALUATION 

EYE  MOVEMENT 

EYE  MOVEMENT 


ROBERTS,  D.N.  79/132 

JONASSEW,  D.H.  81/185 

NIELSON,  T.  80/424 

NIELSON,  T.  80/424 

LA  CROIX,  P.  83/370 

JOSEPH,  M.R.  83/370 

BECKER,  A.O.  62/469 

MUFFOLETTO,  R.  82/469 

HEDBERG,  J.6.  79/244 

TAYLOR,  W.  81/72 

CARLOS,  J.  8«/72 

REGENSCHEID,  J.K.  83/643 

DWYER,  F.  84/72 

BERRY,  L.H.  83/46 

KOETTING,  J.R.  84/307 

BOWIE,  M.M  83/74 

KREY,  C.L.  83/441 

NEWELL,  K.J.  83/1S6 

DAVIDSON,  G.V.  83/156 

FLEMING,  M.  84/163 

HOLLIDAY,  W.G.  81/715 

WINN,  W.D.  81/715 

ROBERTS,  D.M.  82/90 

CANE LOS,  J.  82/27 

MARTIN,  B.L.  83/460 

MORGAN,  R.M.  79/682 

ERNEST,  P.S.  .  82/278 

RAGSDALE,  R.G.  82/543 

HORTON,  J.A.   .  83/318 

WINN,  B.  84/607 
REIGELUTH,  CM.  79/100 
WILLIAMS,  D.M.  92/621 
STREIBEL,  M.J.  81/624 
CHISWELL,  J.  80/98 
LAMBERSKI ,  R.  80/98 
TAYLOR,  W.  83/125 
DWYER,  F.M.  \  81/120 
SZABO,  M.  81/120 
DEMELO,  H.T.  81/120 
CARLOS,  J.  83/125 
ALTSCHULD,  J.     \  83/125 
TURNER,  P.  79/321 
MARTIN,  N.N.  79/321 
GLEASON,  J.J.  81/670 
WATSON-GEGEO,  K.A.  81/670 
GUZMAN -HAL DONA DO,  A. A.  81/670 
YACOBACCI,  P.M.  82/105 
GOLDSTEIN,  M.  82/105 
WILLIAMS,  J.A.  84/563 
SOLANO,  F.     I  82/105 
ALTER,  M.      *  82/105 
LEWIS,  R.F.  79/650 
WILOMAN,  T.  80/630 
BUTTON,  J.    L  80/63° 
GENTRY,  C.  81/147 
BARON.  L.J.  79/158 
NESBIT,  L.J.  81/445 
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EYE  MOVEMENT 
FACULTY 
FEAR  * 
FEAR 
FEEDBACK 
FEEDBACK 
FEEDBACK 
FEEDBACK 
FIELD  DEPENDENCE 
FIELD  DEPENDENCE 
FIELD  DEPENDENCE 
FIELD  DEPENDENCE 
FIELD  DEPENDENCE 
FIELD  DEPENDENCE/ INDEPENDENCE 
FIELD  DEPENDENCE/ INDEPENDENCE 
FIELD  DEPENDENCE/ INDEPENDENCE 
FIELD  DEPENDENCE/ INDEPENDENCE 
FIELD  DEPENDENCE/ INDEPENDENCE 
FIELD  DEPENDENCE/INDEPENDENCE 
FIELD  DEPENDENCE/ INDEPENDENCE 
FIELD  INDEPENDENCE 
FIELD  INDEPENDENCE 
FIELD  TEST 
FILM 
FILM 
FILM 
FILM 

FUNCTIONS 

6ESTALT  APPROACH 

HEMISPHERICITY 

HEMISPHERIC  IT Y 

HIGHER  EDUCATION 

ICONIC  STIMULUS 

ILLUSTRATIONS 

ILLUSTRATIONS 

ILLUSTRATIONS 

ILLUSTRATIONS 

ILLUSTRATIONS 

IMAGERY^ 

IMAGERY 

IMAGERY 

IMAGERY 

IMAGERY 

INDIVIDUAL!^!  ION 
INDUSTRY 
INDUSTRY 
INDUSTRY 

INFORMATION  CUEING 
INFORMATION  CUEING 
INFORMATION  CUEING 
INFORMATION  PROCESSING 
INFORMATION  PROCESSING 
INFORMATION  PROCESSING 
INFORMATION  PROCESSING 
INSTRUCTION 
INSTRUCTION 
INSTRUCTIONAL  DESIGN 


NES81T,  L.L. 
MELLON,  C.S. 
BERRY,  T. 
SIMONSON,  M.R. 
ISRAELITE,  L. 
CAREY,  L.M. 
SCHMIO,  R.F* 
HANNAFIN,  M. 
SIMONSON,  M. 
CANE LOS,  J. 
KLOOCK,  T.R. 
COOK,  S.  . 
TAYLOR,  N. 
ATANG,  C.K 
DAVIDSON,  G.V. 
SHERIFF,  O.E 
KREY,  C.L. 
NEWELL,  K.J, 
WILLIAMS,  J. A,* 
CANaOS,  J. 
JOSEPH,  M.R. 
LA  CROIX,  P. 
WINN,  B. 
TYSON,  L. 
ROBINSON,  R.S. 

RABURN,  J. 

SIMONSON,  M.R. 

BRODY,  P.J. 

BECKER,  A. 

RANCOURT,  R. 

DIONNE,  J. P. 

HEDBERG,  J.G. 

WISE,  R.E. 

SEWELL,  E.H. 

JOSEPH,  J. 

Will  TAKER,  J. 

SULLIVAN,  H. 

DUCHASTEL,  P. 

HORTIN,  J.A. 

MOSLEY,  M.L. 

LAMBERSKI,~R. 

CHISWELL,  J. 

STORY,  N.O. 

RAGAN,  T. 

ESQUE,  T. 

KENNEDY,  P. 
'  NOVAK,  J. 

TAYLOR,  W. 

CANE LOS,  J. 

ALTSCHULD,  J. 

SEWELL,  E.H. 

TAYLOR ,  W. 

CANE LOS,  J. 

WINN,  W. 

JENNINGS*,  T. 

FRENCH,  M. 

BERBEKAR,  R. 


82/478 
82/453 
83/58 
83/S8 
79/212 
79/212 
79/212 
80/244 
82/439 
81/88 
82/439 
82/439 
81/88 
84/1 
83/1S6 
80/445 
83/441 
83/156 
80/445 
80/85 
83/370 
83/370 

79/580 

82/519' 

81/535 

82/519 

81/586 

83/96 

80/55 

81/486 

81/486 

79/244 

82/671 

79/496 

80/311 

80/569 

80/569 

81/137 

84/240 

83/707 

80/98 

80/98 

83/707 

84/433 

84/394 

83/394 

83/394 

83/125 

83/125 

83/125 

79/496 

81/88 

81/88 

80/646 

80/280 

84/178  j 

83/736/  • 
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INSTRUCTIONAL  DESIGN 

KOETTING,  J.R. 

,84/307  ' 

INSTRUCTIONAL  DESIGN 
INSTRUCTIONAL  DESIGN 

mr  WW^r  W  mmm  mmmm  9  mw  mm  w  mm  »  mm      ■mmrnmwww  m  mm^  w 

INSTRUCTIONAL  RESIGN 

•  fTW  •  ™ ^ ^f^^  w  mm  mmrmrmm  w mm      mrnmmmm  mw  mmmrm 

\  BOVY,  R.C. 

81/35 

SIMONSON,  M. 

^  79/521 

WILLIAMS,  J.A. 

84/553 

mw  m  m  mm  m*  mm 

INSTRUCTIONAL  DESIGN!  » 

DODGE,  J.  . 

80/166 

INSTRUCTIONAL  DESIGN 

•  •^■p  |i»             w  W  mmmmm  mmmm       mm-mm  mm*  mw  -mmr^w 

BRANSON,  R.K. 

79/602 

INSTRUCTIONAL  DESIGN 

JACKSON,  A. 

83/736 

INSTRUCTIONAL'  OESIGN 

GRABOWSKI,  B. 

82/46 

INSTRUCTIONAL  OESIGN 

MARTIN,  N.N. 

79/321 

INSTRUCTIONAL  DESIGN 

GENTRY,  G. 

81/147 

INSTRUCTIONAL  OESIGN 

REI6ELUTH,  CM. 

.  79/100 

INSTRUCTIONAL  DESIGN  - 

SMITH,  P.L. 

84/487 

INSTRUCTIONAL  DESIGN 

TURNER,  P. 

79/321 

INSTRUCTIONAL  DESIGN 

KERR,  S.T. 

409 

INSTRUCTIONAL  DESIGN 

MELLON,  C.A. 

82/453 

INSTRUCTIONAL  OESIGN 

WINN,  B. 

83/736 

INSTRUCTIONAL  DESIGN 

REID,  G.A. 

81/509 

INSTRUCTIONAL  DEVELOPMENT 

STRIFE,  D.E. 

80/445 

INSTRUCTIONAL  DEVELOPMENT 

BECKWITH,  0. 

83/t  ✓ 

INSTRUCTIONAL  DEVELOPMENT 

WILLIAMS,  J.A. 

80/445 

INSTRUCTIONAL  EFFECT 

m>  •  wmr  *  wm •  41  mmw w  mm*     m*9   f    »  mm  w 

OWYER,  F.M. 

82/15 

INSTRUCTIONAL  EFFECT 

•  ■  W  W  F  ■  ~  lftw  ■   mr  mm  w.  mm  m  mm      mmw  m    m    mm  mm  , 

DWYER,  F.M. 

83/203 

INSTRUCTIONAL  EFFECT 

PP  w  w  Ww  W  W  W  Ww  WW  w    w*»  wW  ■  ww  w  P^       ww  w     w     ww  ww  w 

DE  MELO,  H.T. 

82/40 

INSTRUCTIONAL  EFFECT 

m   WW  WW    W  W  W  "mmW  ^PF    w     WM  WW  ~  WW  ▼  WMm          P*  ~      *      mmmW  WW    w  m 

LAMBERSKI ,  R.J. 

82/64 

INSTRUCTIONAL  EFFECT 

DE  MELO,  H. 

83/203 

INSTRUCTIONAL  EFFECT 

DWYER,  F.M. 

82/60 

INSTRUCTIONAL  EFFECT 

m*  mTf  mm  %  V  m  mm  mm  »    mt  mm  m  mm  m  mm       mm  w    m     mm  mm  » 

ARNOLD,  T.C. 

82/15 

INSTRUCTIONAL  EFFECT 

(p)  If  W   V  wW  |pV  W    mm  V  *  WW  P  P^b        WW  W     w      WW  WW  w 

JOSEPH,  J.H. 

79/380 

INSTRUCTIONAL  EFFECT 

m  WW  mm  w  Wm  mm  mm  w  mr  mjmwmm  m  mm     wm>  w    w    mm  mm  ■ 

OWYER,  F.M. 

82/40 

INSTRUCTIONAL  EFFECT 

JOSFPH,  J.H, 

82/60 

INSTRUCTIONAL  INNOVATION 

HEDBERG,  J.G. 

79/244 

INSTRUCTIONAL  MANAGEMENT 

.  BRUCE,  K.Li 

84/331 

INSTRUCTIONAL  MANAGEMENT  • 

^  ff  V  v  WW  WmwWMW  w    pj  mw  w        ^  P»       w  Wmw  mw  mw  m  m^w-m*  w  w  %%%%%  ■  w  * 

'   MCCOMBS,  B.L. 

84/331 

INSTRUCTIONAL  MEDIA 

#p  w  WWw  w  w  m  mw  mw  w    #■  my  ■  iw  ■            ■           ^f'  •  *  ■ 

COOK,  S. 

82/439 

INSTRUCTIONAL  MEDIA 

LEVIE,  W.H. 

80/201 

INSTRUCTIONAL  MEDIA 

KL00CK,  T.R. 

82/439 

INSTRUCTIONAL  MEDIA 

FLEMING,  M. 

80/201 

INSTRUCTIONAL  MEDIA 

SIMONSON, 

82/439 

INSTRUCTIONAL  MEDIA 

WINN,  B. 

79/580 

INSTRUCTIONAL  MEDIA 

MCLESKEY,  J. 

80/201 

INSTRUCTIONAL  MEDIA 

SIMONSON,  M.fl. 

80/473 

INSTRUCTIONAL  METHODS 

•  *  ▼  ww    W  W  ^9  mgw  mmr    w     w  mw  w  ww  w  m+       w   w          T    ■  p 

MOORE.  P.M. 

■  WW  WW  T  ^           WM           WM"  W    ~    9  W 

81/471 

INSTRUCTIONAL  METHODS 

BRODY,  P.J. 

84/44 

INSTRUCTIONAL  METHODS 

OXFORD,  J.F. 

81/471 

INSTRUCTIONAL  STRATEGIES 

LA  CROIX,  P. 

83/370 

INSTRUCTIONAL  STRATEGIES  • 

JOSEPH,  M.R. 

83/370 

INSTRUCTIONAL  SYSTEMS 

YACOBACCI,  P.M. 

82/105 

INSTRUCTIONAL  SYSTEMS 

ALTER,  M. 

62/105 

mWmw  §  •  mm  9m 

INSTRUCTIONAL  SYSTEMS 

91  V  V  0^  ■  W  VPT^PJF  ▼    mr  Ww  9  w*r  m  WAmf        mw   w  WW   w  WWW  Ww 

GOLDSTEIN,  M. 

^■f^F  WAw  wr  wmw   m  ww  ■  I*  ■        w  ■  p 

82/105 

Wrmm*  f   m  mm  mr 

INSTRUCTIONAL  SYSTEMS 

Wr  9  W/WmW   WWW  wmrmw   W    V  WW  W  W*  w  WMw        WW   W   Ww    W  WW w  w  Ww 

SOLANO.  F. 

v.  82/105 

wmr            *tmmm  f  •  mm  mm 

INSTRUCTIONAL  TECHNOLOGY 

WW  w  www  www  Ww^**  W    m  "Wr     ww  w  WW         W  WW  mw  ~  WW  W  m  w  W»  WW  Ww  F 

BURTON,  J. 

WW  Ww~  W    W   WT1  ■          w  W 

80/630 

mwmr  ^  mwmmmm 

INSTRfXTlONAL  TECHNOLOGY 

m  m  mmm  m  mm  mw  mm  w  w*<f  »W       *  mm  mm  m  w  m  mm  r  mmp  mm  mm  w 

WILOMAN,  T. 

mm  m  mm  mrm  ww  mw  m  m        w  w 

80/630 

INSTRUCTIONAL  TECHNOLOGY 

KOETTING,  J.R. 

83/416 

INSTRUCTIONAL  TEXTS 

BRODY,  P. 

80/70 

INSTRUCTIONAL  VARIABLES 

DWYER,  F.M. 

83/175 
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